00000001:02000400:2.0F:1783969182.943093:0:2960:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing set_hostid 00000001:02000400:2.0:1783969191.480959:0:3162:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1783969192.403348:0:3221:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1311 MB/s 00000001:01000000:3.0:1783969192.653436:0:3221:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1663 MB/s 00000001:01000000:3.0:1783969192.902923:0:3221:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10203 MB/s 00000020:02000000:2.0:1783969193.207168:0:3254:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_162_g313aea1 00000400:02000000:2.0:1783969193.583293:0:3269:0:(api-ni.c:2768:lnet_startup_lndni()) Added LNI 192.168.203.139@tcp [8/256/0/180] 00008000:02000000:0.0F:1783969197.183328:0:3419:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1783969253.122793:0:5231:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1783969263.032193:0:5774:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783969263.032199:0:5774:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1783969263.032321:0:5774:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000019027bbf 00000080:02000400:2.0:1783969263.032331:0:5774:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1783969263.037519:0:5774:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1783969263.037533:0:5774:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1783969263.037663:0:5774:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000000cfa9d58) 00000020:00000080:3.0:1783969263.037683:0:5774:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783969263.054452:0:5774:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1783969263.055097:0:5774:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1783969263.114012:0:5774:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1783969263.114054:0:5774:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783969263.114086:0:5774:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1783969263.114146:0:5774:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783969263.114175:0:5774:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1783969263.114620:0:5774:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1783969263.114628:0:5774:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783969263.114638:0:5774:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbacf56d076faaa07 00000020:01000004:2.0:1783969263.114644:0:5774:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1783969263.114649:0:5774:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1783969263.114653:0:5774:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000019027bbf from MGS 00000020:01000004:2.0:1783969263.114658:0:5774:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1783969263.114675:0:5774:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000084a30571) 00000020:00000080:2.0:1783969263.114687:0:5774:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1783969263.114789:0:5774:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000019027bbf from MGS, refs=2 00080000:01000000:2.0:1783969263.114795:0:5774:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783969263.114800:0:5774:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbacf56d076faaa15 00000100:00100000:2.0:1783969263.115063:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1783969263.115196:0:5774:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1783969263.115207:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1783969263.123837:0:5774:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1783969263.123854:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1783969263.124796:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783969263.124998:0:5774:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1783969263.125004:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1783969263.126196:0:5774:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1783969263.126205:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1783969263.126619:0:5774:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1783969263.126626:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1783969263.129647:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969263.129653:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969263.129654:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969263.130680:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969263.130684:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969263.130685:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969263.131391:0:5774:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1783969263.136347:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1783969263.382044:0:5774:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2964 MB/s 00000001:01000000:0.0:1783969263.631924:0:5774:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2619 MB/s 00000001:01000000:2.0:1783969263.883355:0:5774:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 362 MB/s 00000001:01000000:3.0:1783969264.138713:0:5774:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 513 MB/s 00080000:10000000:0.0:1783969264.157390:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1783969264.165042:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1783969264.185454:0:5774:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1783969264.185472:0:5774:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1783969264.185475:0:5774:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1783969264.200100:0:5784:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1783969264.200197:0:5774:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1783969264.200253:0:5774:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1783969264.200491:0:5774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1783969264.200520:0:5774:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1783969264.200834:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783969264.201691:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1783969264.201698:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0F:1783969264.205174:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1783969264.205191:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1783969264.205543:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1783969264.205549:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1783969264.206229:0:5774:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1783969264.206248:0:5774:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.139@tcp' 00000020:01000004:0.0:1783969264.206250:0:5774:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1783969264.206288:0:5774:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.139@tcp (typ=mgc) 00000020:00000080:0.0:1783969264.206307:0:5774:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.139@tcp (00000000e67dc860) 00000020:00000080:0.0:1783969264.206323:0:5774:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1783969264.206441:0:5774:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ae6a7539@MGC192.168.203.139@tcp: add connection 192.168.203.139@tcp at head 00010000:00010000:0.0:1783969264.206585:0:5774:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.139@tcp-0 is initialized 00000040:01000000:0.0:1783969264.206591:0:5774:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.139@tcp ctxt 1 is initialized 00000100:00080000:1.0:1783969264.206751:0:5789:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1783969264.212627:0:5790:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1783969264.213594:0:5774:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.139@tcp (uuid c893ad09-f78f-4711-bea5-6489668294ed) 00000020:00000080:3.0:1783969264.213619:0:5774:0:(genops.c:1406:class_connect()) connect: client c893ad09-f78f-4711-bea5-6489668294ed, cookie 0xbacf56d076faaa23 00000100:00080000:3.0:1783969264.213631:0:5774:0:(import.c:510:import_select_connection()) MGC192.168.203.139@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783969264.213637:0:5774:0:(import.c:624:import_select_connection()) MGC192.168.203.139@tcp: import 00000000ae6a7539 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1783969264.213681:0:5774:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ac959cca x1870627280519296/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783969264.213700:0:5774:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c893ad09-f78f-4711-bea5-6489668294ed->MGS 00000020:01000004:3.0:1783969264.213716:0:5774:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1783969264.213720:0:5774:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1783969264.213734:0:5774:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000081cf1b9c) 00000020:00000080:3.0:1783969264.213745:0:5774:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1783969264.216332:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ac959cca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c893ad09-f78f-4711-bea5-6489668294ed:3284:1870627280519296:0@lo:250: 00000100:00100000:2.0:1783969264.216432:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969264.216831:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280519296 00000100:00100000:0.0:1783969264.216839:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280519296 00000100:00100000:0.0:1783969264.216903:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783969264.216909:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003cf405d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3284:x1870627280519296:12345-0@lo:250: 00010000:00080000:0.0:1783969264.216934:0:5786:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from c893ad09-f78f-4711-bea5-6489668294ed@0@lo t0 exp 0000000000000000 cur 121 last 0 00000020:00000080:0.0:1783969264.216976:0:5786:0:(genops.c:1406:class_connect()) connect: client c893ad09-f78f-4711-bea5-6489668294ed, cookie 0xbacf56d076faaa31 00000100:00080000:0.0:1783969264.217106:0:5786:0:(import.c:65:import_set_state_nolock()) 00000000f4b2f14f : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783969264.217185:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003cf405d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+5:3284:x1870627280519296:12345-0@lo:250: Request processed in 274us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969264.217199:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783969264.217469:0:3284:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.139@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1783969264.217478:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.139@tcp: connect to target with instance 0 00000100:00080000:2.0:1783969264.217484:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.139@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1783969264.217487:0:3284:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1783969264.217490:0:3284:0:(import.c:65:import_set_state_nolock()) 00000000ae6a7539 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1783969264.217493:0:3284:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1783969264.217500:0:3284:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1783969264.217504:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ac959cca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c893ad09-f78f-4711-bea5-6489668294ed:3284:1870627280519296:0@lo:250: 00000100:00100000:2.0:1783969264.248654:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783969264.248815:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1783969264.248821:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1783969264.251766:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1783969264.251778:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1783969264.255840:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1783969264.255854:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1783969264.257384:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783969264.257558:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1783969264.257571:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1783969264.258282:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1783969264.258289:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1783969264.316408:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783969264.317160:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1783969264.317169:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1783969264.322088:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1783969264.322108:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1783969264.323394:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783969264.323549:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783969264.323560:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1783969264.325797:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783969264.325809:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1783969264.326451:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783969264.326604:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783969264.326609:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1783969264.327270:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783969264.327285:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1783969264.327782:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783969264.328090:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783969264.328095:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1783969264.328461:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783969264.328466:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1783969264.354051:0:5774:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783969264.354243:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783969264.354249:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1783969264.355846:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783969264.355991:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1783969264.356489:0:5774:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783969264.356496:0:5774:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1783969264.359751:0:5774:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1783969264.359780:0:5774:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1783969264.359785:0:5774:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.139@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1783969264.359931:0:5774:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.139@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783969264.359966:0:5774:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.139@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1783969264.359971:0:5774:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783969264.359972:0:5774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783969264.359973:0:5774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783969264.359974:0:5774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783969264.359975:0:5774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783969264.359976:0:5774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783969264.359977:0:5774:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783969264.359979:0:5774:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783969264.359980:0:5774:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783969264.359981:0:5774:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783969264.359983:0:5774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783969264.359985:0:5774:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783969264.359987:0:5774:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1783969264.359989:0:5774:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783969264.359990:0:5774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783969264.359991:0:5774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783969264.359992:0:5774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783969264.359993:0:5774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783969264.359995:0:5774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783969264.359996:0:5774:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783969264.359997:0:5774:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783969264.359998:0:5774:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783969264.359999:0:5774:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783969264.360000:0:5774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783969264.360001:0:5774:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783969264.360025:0:5774:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783969264.360041:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004f3ac4e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280519424:0@lo:253: 00000100:00100000:3.0:1783969264.360118:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969264.360226:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280519424 00000100:00100000:2.0:1783969264.360232:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280519424 00000100:00100000:2.0:1783969264.360275:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783969264.360282:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a0bb91d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+5:5774:x1870627280519424:12345-0@lo:253: 20000000:01000000:2.0:1783969264.360328:0:5788:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783969264.360331:0:5788:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 00000100:00100000:3.0:1783969264.361154:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f5b10a27 going to sleep for 11 seconds 10000000:01000000:0.0:1783969264.361325:0:5809:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1783969264.361384:0:5788:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1783969264.361655:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783969264.362695:0:5810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1783969264.363076:0:5788:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783969264.363080:0:5788:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1783969264.363085:0:5788:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1783969264.363088:0:5788:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1783969264.363100:0:5788:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1783969264.363446:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783969264.363716:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1783969264.363728:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783969264.363773:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1783969264.363821:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1783969264.364086:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1783969264.364185:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1783969264.364194:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1783969264.364254:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1783969264.364264:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1783969264.364301:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1783969264.364309:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1783969264.364341:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1783969264.364394:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1783969264.364424:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1783969264.364429:0:5788:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1783969264.364445:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783969264.364712:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1783969264.364722:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1783969264.364755:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1783969264.364790:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1783969264.364843:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1783969264.364854:0:5788:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1783969264.365162:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1783969264.365170:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1783969264.365212:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1783969264.365251:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1783969264.365285:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1783969264.365295:0:5788:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1783969264.365389:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1783969264.365398:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1783969264.365434:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1783969264.365482:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1783969264.365704:0:5788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1783969264.365752:0:5788:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1783969264.365759:0:5788:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1783969264.366268:0:5811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1783969264.366524:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1783969264.366543:0:5788:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.139@tcp for mdt 20000000:01000000:0.0:1783969264.366545:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.139@tcp (null) (null) (null) 00000040:00080000:0.0:1783969264.366580:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1783969264.366588:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1783969264.366690:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1783969264.366699:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.139@tcp (null) (null) 00000040:00080000:0.0:1783969264.366746:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1783969264.366755:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1783969264.366787:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1783969264.366824:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1783969264.367048:0:5788:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1783969264.367052:0:5788:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1783969264.367055:0:5788:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1783969264.367073:0:5788:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1783969264.367076:0:5788:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1783969264.367113:0:5788:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1783969264.367115:0:5788:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783969264.367429:0:5812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1783969264.375434:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1783969264.375487:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1783969264.375523:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1783969264.375534:0:5788:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1783969264.375536:0:5788:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1783969264.376675:0:5813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1783969264.377000:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1783969264.377043:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1783969264.377116:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1783969264.377131:0:5788:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783969264.377133:0:5788:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1783969264.377137:0:5788:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1783969264.377140:0:5788:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1783969264.377145:0:5788:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1783969264.377150:0:5788:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1783969264.377552:0:5814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1783969264.379173:0:5788:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1783969264.420241:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1783969264.420299:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1783969264.420564:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1783969264.420586:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783969264.420606:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e40bea74/0xbacf56d076faaa38 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969264.420621:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e40bea74/0xbacf56d076faaa38 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969264.420631:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e40bea74/0xbacf56d076faaa38 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969264.420636:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e40bea74/0xbacf56d076faaa38 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969264.420643:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e40bea74/0xbacf56d076faaa38 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969264.420648:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e40bea74/0xbacf56d076faaa38 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969264.420655:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e40bea74 already unused, calling callback (000000001ed8b2cd) 00010000:00010000:3.0:1783969264.420658:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e40bea74/0xbacf56d076faaa38 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969264.420665:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e40bea74/0xbacf56d076faaa38 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969264.420676:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e40bea74/0xbacf56d076faaa38 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969264.420697:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e40bea74/0xbacf56d076faaa38 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969264.420701:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e40bea74/0xbacf56d076faaa38 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783969264.420717:0:5788:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1783969264.713953:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a0bb91d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+5:5774:x1870627280519424:12345-0@lo:253: Request processed in 353665us (353828us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969264.713972:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783969264.714043:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004f3ac4e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280519424:0@lo:253: 10000000:01000000:2.0:1783969264.714056:0:5774:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783969264.714068:0:5774:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783969264.714070:0:5774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783969264.714071:0:5774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969264.714073:0:5774:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1783969264.714074:0:5774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969264.714075:0:5774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969264.714076:0:5774:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783969264.714078:0:5774:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783969264.714079:0:5774:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1783969264.714080:0:5774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969264.714082:0:5774:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783969264.714110:0:5774:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000019027bbf from lustre-MDT0000 10000000:01000000:2.0:1783969264.714131:0:5774:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1783969264.714134:0:5774:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783969264.714138:0:5774:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ac7917f19c0 10000000:01000000:2.0:1783969264.714142:0:5774:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783969264.714148:0:5774:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9ac7917f19c0 from 1 10000000:01000000:2.0:1783969264.714151:0:5774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783969264.714194:0:5774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 00000000af71c796/0xbacf56d076faaa3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969264.714204:0:5774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: 00000000af71c796/0xbacf56d076faaa3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969264.714212:0:5774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 00000000af71c796/0xbacf56d076faaa3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969264.714228:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000adb64e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280519552:0@lo:101: 00000100:00100000:2.0:1783969264.714258:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969264.714394:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 000000001e5aedd1 going to sleep for 11 seconds 00000100:00100000:1.0:1783969264.714539:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280519552 00000100:00100000:1.0:1783969264.714544:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280519552 00000100:00100000:1.0:1783969264.714736:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783969264.714744:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ade127b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+5:5774:x1870627280519552:12345-0@lo:101: 00010000:00010000:1.0:1783969264.714756:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969264.714769:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f7c7bad3/0xbacf56d076faaa46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faaa3f expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969264.714791:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f7c7bad3/0xbacf56d076faaa46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faaa3f expref: 6 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969264.714801:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f7c7bad3/0xbacf56d076faaa46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faaa3f expref: 6 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969264.714808:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f7c7bad3, rc 0) 00000100:00100000:1.0:1783969264.714844:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ade127b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+6:5774:x1870627280519552:12345-0@lo:101: Request processed in 102us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969264.714909:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783969264.714965:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000adb64e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280519552:0@lo:101: 00010000:00010000:2.0:1783969264.714977:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 00000000af71c796/0xbacf56d076faaa3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaa46 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969264.714985:0:5774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 00000000af71c796/0xbacf56d076faaa3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faaa46 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969264.715027:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000adb64e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280519680:0@lo:501: 00000100:00100000:2.0:1783969264.715048:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969264.715172:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 000000001e5aedd1 going to sleep for 11 seconds 00000100:00100000:0.0:1783969264.715327:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280519680 00000100:00100000:0.0:1783969264.715331:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280519680 00000100:00100000:3.0:1783969264.715377:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783969264.715383:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055635018 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+6:5774:x1870627280519680:12345-0@lo:501: 00000100:00100000:3.0:1783969264.715581:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055635018 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+6:5774:x1870627280519680:12345-0@lo:501: Request processed in 198us (532us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783969264.715588:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783969264.716226:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000adb64e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280519680:0@lo:501: 10000000:01000000:2.0:1783969264.716266:0:5774:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783969264.716346:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 00000000af71c796/0xbacf56d076faaa3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaa46 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969264.716357:0:5774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: 00000000af71c796/0xbacf56d076faaa3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaa46 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969264.716372:0:5774:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ac783021000 10000000:01000000:2.0:1783969264.716376:0:5774:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783969264.716381:0:5774:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ac783021000 10000000:01000000:2.0:1783969264.716383:0:5774:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783969264.716386:0:5774:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9ac783021000 from 1 10000000:01000000:2.0:1783969264.716388:0:5774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783969264.716409:0:5774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 000000002b6058dd/0xbacf56d076faaa4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969264.716415:0:5774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: 000000002b6058dd/0xbacf56d076faaa4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969264.716423:0:5774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 000000002b6058dd/0xbacf56d076faaa4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969264.716436:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000adb64e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280519808:0@lo:101: 00000100:00100000:2.0:1783969264.716469:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969264.716498:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 000000001e5aedd1 going to sleep for 11 seconds 00000100:00100000:2.0:1783969264.716514:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280519808 00000100:00100000:2.0:1783969264.716519:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280519808 00000100:00100000:2.0:1783969264.716541:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783969264.716547:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070db8e1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+6:5774:x1870627280519808:12345-0@lo:101: 00010000:00010000:2.0:1783969264.716564:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969264.716579:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009c4b6c31/0xbacf56d076faaa54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faaa4d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969264.716595:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009c4b6c31/0xbacf56d076faaa54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faaa4d expref: 7 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969264.716610:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009c4b6c31/0xbacf56d076faaa54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faaa4d expref: 7 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969264.716616:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009c4b6c31, rc 0) 00000100:00100000:2.0:1783969264.716972:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070db8e1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+7:5774:x1870627280519808:12345-0@lo:101: Request processed in 425us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969264.716979:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783969264.717006:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000adb64e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280519808:0@lo:101: 00010000:00010000:2.0:1783969264.717015:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 000000002b6058dd/0xbacf56d076faaa4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaa54 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969264.717023:0:5774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 000000002b6058dd/0xbacf56d076faaa4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faaa54 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969264.717034:0:5774:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783969264.717037:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 000000002b6058dd/0xbacf56d076faaa4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaa54 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969264.717043:0:5774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: 000000002b6058dd/0xbacf56d076faaa4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaa54 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969264.717048:0:5774:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783969264.717067:0:5774:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783969264.717072:0:5774:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ac783021000 10000000:01000000:2.0:1783969264.717074:0:5774:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1783969264.717077:0:5774:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1783969264.717079:0:5774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783969264.717093:0:5774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 000000007733b021/0xbacf56d076faaa5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969264.717098:0:5774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: 000000007733b021/0xbacf56d076faaa5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969264.717104:0:5774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 000000007733b021/0xbacf56d076faaa5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969264.717115:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000adb64e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280519936:0@lo:101: 00000100:00100000:2.0:1783969264.717140:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969264.717147:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 000000001e5aedd1 going to sleep for 11 seconds 00000100:00100000:2.0:1783969264.717167:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280519936 00000100:00100000:2.0:1783969264.717170:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280519936 00000100:00100000:2.0:1783969264.717187:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783969264.717191:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f94b14d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+7:5774:x1870627280519936:12345-0@lo:101: 00010000:00010000:2.0:1783969264.717198:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969264.717205:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000030f741be/0xbacf56d076faaa62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faaa5b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969264.717217:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000030f741be/0xbacf56d076faaa62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faaa5b expref: 8 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969264.717224:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000030f741be/0xbacf56d076faaa62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faaa5b expref: 8 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969264.717240:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000030f741be, rc 0) 00000100:00100000:2.0:1783969264.717264:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f94b14d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+8:5774:x1870627280519936:12345-0@lo:101: Request processed in 73us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969264.717333:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783969264.717355:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000adb64e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280519936:0@lo:101: 00010000:00010000:2.0:1783969264.717372:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 000000007733b021/0xbacf56d076faaa5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaa62 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969264.717379:0:5774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 000000007733b021/0xbacf56d076faaa5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faaa62 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969264.717415:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000adb64e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280520064:0@lo:501: 00000100:00100000:2.0:1783969264.717437:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969264.717444:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 000000001e5aedd1 going to sleep for 11 seconds 00000100:00100000:2.0:1783969264.717461:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280520064 00000100:00100000:2.0:1783969264.717465:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280520064 00000100:00100000:2.0:1783969264.717478:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783969264.717482:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045b86f3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+8:5774:x1870627280520064:12345-0@lo:501: 00000100:00100000:2.0:1783969264.721541:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045b86f3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+9:5774:x1870627280520064:12345-0@lo:501: Request processed in 4050us (4096us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969264.721556:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783969264.721609:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000adb64e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280520064:0@lo:501: 00000100:00100000:2.0:1783969264.721744:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000adb64e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280520192:0@lo:503: 00000100:00100000:2.0:1783969264.721789:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969264.721802:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 000000001e5aedd1 going to sleep for 11 seconds 00000100:00100000:2.0:1783969264.721838:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280520192 00000100:00100000:2.0:1783969264.721844:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280520192 00000100:00100000:2.0:1783969264.721888:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783969264.721894:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a4bbf59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+9:5774:x1870627280520192:12345-0@lo:503: 00000100:00100000:2.0:1783969264.722042:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a4bbf59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+9:5774:x1870627280520192:12345-0@lo:503: Request processed in 148us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969264.722048:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783969264.722086:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000adb64e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280520192:0@lo:503: 00000100:00100000:3.0:1783969264.722715:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000045e8bf8c pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:5817:1870627280520320:0@lo:502: 00000100:00100000:3.0:1783969264.722753:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969264.722793:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 0000000013ec4bbe going to sleep for 11 seconds 00000100:00100000:0.0:1783969264.722886:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280520320 00000100:00100000:0.0:1783969264.722890:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280520320 00000100:00100000:0.0:1783969264.722909:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783969264.722914:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096d27441 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+9:5817:x1870627280520320:12345-0@lo:502: 00000100:00100000:0.0:1783969264.723048:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096d27441 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+9:5817:x1870627280520320:12345-0@lo:502: Request processed in 133us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969264.723054:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783969264.723161:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000045e8bf8c pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:5817:1870627280520320:0@lo:502: 00000020:01000000:3.0:1783969264.723181:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969264.723190:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969264.723192:0:5817:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783969264.723196:0:5817:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1783969264.723199:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783969264.723210:0:5817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000080935472) 00000020:00000080:3.0:1783969264.723227:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1783969264.723230:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1783969264.723357:0:5817:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1783969264.723418:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbacf56d076faaa70 00000020:00000080:3.0:1783969264.723605:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783969264.723608:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969264.723618:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969264.723619:0:5817:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783969264.723622:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969264.723625:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969264.723626:0:5817:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1783969264.723628:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783969264.723702:0:5817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000fe6f5cdf) 00000020:00000080:3.0:1783969264.723713:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1783969264.723718:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1783969264.723719:0:5817:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1783969264.723721:0:5817:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1783969264.723727:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783969264.723778:0:5817:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000019027bbf from lustre-MDT0000, refs=3 00000020:00000080:3.0:1783969264.723797:0:5817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000009a0dd3b9) 00000020:00000080:3.0:1783969264.723805:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1783969264.723857:0:5817:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1783969264.723905:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbacf56d076faaa85 00000020:00000080:3.0:1783969264.724008:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1783969264.724014:0:5817:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1783969264.724019:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xbacf56d076faaa8c 00080000:01000000:3.0:1783969264.724024:0:5817:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1783969264.724027:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbacf56d076faaa93 00080000:10000000:3.0:1783969264.724820:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1783969264.725115:0:5817:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1783969264.731255:0:5817:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1783969264.823007:0:5817:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1783969264.823570:0:5817:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1783969264.833082:0:5817:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1783969264.833396:0:5817:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1783969264.958541:0:5817:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000000d4aaef8) 00000020:00000080:1.0:1783969264.958566:0:5817:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1783969264.959078:0:5817:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1783969264.959086:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbacf56d076faaaa1 00000020:00000080:1.0:1783969264.959828:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1783969264.963663:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1783969265.030230:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1783969265.064581:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1783969265.111142:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1783969265.161509:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00010000:00010000:0.0:1783969265.188998:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1783969265.202811:0:5817:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1783969265.280341:0:5817:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xbacf56d076faaaa8 00000020:00000080:0.0:1783969265.280803:0:5817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1783969265.280814:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969265.280820:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969265.280823:0:5817:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1783969265.280826:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969265.280830:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969265.280831:0:5817:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783969265.280834:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783969265.280836:0:5817:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783969265.280838:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969265.280840:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969265.280841:0:5817:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783969265.280843:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969265.280848:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969265.280849:0:5817:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1783969265.280853:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1783969265.280913:0:5817:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1783969265.280974:0:5817:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000168b51e9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:5817:1870627280520448:0@lo:502: 00000100:00100000:0.0:1783969265.281052:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969265.281113:0:5817:0:(client.c:2702:ptlrpc_set_wait()) set 0000000016f03e30 going to sleep for 11 seconds 00000100:00100000:2.0:1783969265.281270:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280520448 00000100:00100000:2.0:1783969265.281277:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280520448 00000100:00100000:2.0:1783969265.281322:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783969265.281330:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c0e350f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+9:5817:x1870627280520448:12345-0@lo:502: 00000100:00100000:3.0:1783969265.290215:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c0e350f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+9:5817:x1870627280520448:12345-0@lo:502: Request processed in 8880us (9157us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969265.290230:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783969265.290295:0:5817:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000168b51e9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:5817:1870627280520448:0@lo:502: 00000020:01000000:0.0:1783969265.290344:0:5817:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969265.290350:0:5817:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969265.290352:0:5817:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1783969265.290356:0:5817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1783969265.290617:0:5774:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1783969265.290635:0:5774:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783969265.290657:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 000000007733b021/0xbacf56d076faaa5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaa62 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969265.290668:0:5774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: 000000007733b021/0xbacf56d076faaa5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaa62 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969265.290675:0:5774:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ac783021000 from 1 10000000:01000000:1.0:1783969265.290678:0:5774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783969265.290743:0:5774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 00000000c0c19316/0xbacf56d076faaaaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969265.290751:0:5774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: 00000000c0c19316/0xbacf56d076faaaaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969265.290760:0:5774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 00000000c0c19316/0xbacf56d076faaaaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969265.290779:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a1799b57 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280520576:0@lo:101: 00000100:00100000:1.0:1783969265.290825:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969265.290914:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 0000000059f1322b going to sleep for 11 seconds 00000100:00100000:2.0:1783969265.291568:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280520576 00000100:00100000:2.0:1783969265.291577:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280520576 00000100:00100000:2.0:1783969265.291625:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783969265.291633:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008578a24c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+9:5774:x1870627280520576:12345-0@lo:101: 00010000:00010000:2.0:1783969265.291647:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969265.291662:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006d6c1947/0xbacf56d076faaab6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faaaaf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969265.291684:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006d6c1947/0xbacf56d076faaab6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faaaaf expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969265.291692:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006d6c1947/0xbacf56d076faaab6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faaaaf expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969265.291700:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006d6c1947, rc 0) 00000100:00100000:2.0:1783969265.292322:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008578a24c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+10:5774:x1870627280520576:12345-0@lo:101: Request processed in 687us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969265.292341:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783969265.293329:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a1799b57 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280520576:0@lo:101: 00010000:00010000:1.0:1783969265.293361:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 00000000c0c19316/0xbacf56d076faaaaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaab6 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969265.293373:0:5774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 00000000c0c19316/0xbacf56d076faaaaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faaab6 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969265.294295:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000168b51e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280520704:0@lo:256: 00000100:00100000:0.0:1783969265.294360:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969265.294414:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 0000000016f03e30 going to sleep for 11 seconds 00000100:00100000:3.0:1783969265.294481:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280520704 00000100:00100000:3.0:1783969265.294488:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280520704 00000100:00100000:3.0:1783969265.294680:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783969265.294689:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000420d1c8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+10:5774:x1870627280520704:12345-0@lo:256: 20000000:01000000:3.0:1783969265.294721:0:5786:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1783969265.294727:0:5786:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1783969265.295167:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000168b51e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280520704:0@lo:256: 00000100:00100000:3.0:1783969265.295708:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000420d1c8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+10:5774:x1870627280520704:12345-0@lo:256: Request processed in 1020us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969265.295728:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 10000000:01000000:2.0:1783969265.296497:0:5774:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783969265.296523:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 00000000c0c19316/0xbacf56d076faaaaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaab6 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969265.296535:0:5774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: 00000000c0c19316/0xbacf56d076faaaaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaab6 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969265.296544:0:5774:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ac783021000 from 1 10000000:01000000:2.0:1783969265.296546:0:5774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783969265.296579:0:5774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 00000000b70c2217/0xbacf56d076faaabd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969265.296587:0:5774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: 00000000b70c2217/0xbacf56d076faaabd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969265.296596:0:5774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 00000000b70c2217/0xbacf56d076faaabd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969265.296614:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000adb64e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280520832:0@lo:101: 00000100:00100000:2.0:1783969265.296664:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969265.296704:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 0000000097904353 going to sleep for 11 seconds 00000100:00100000:0.0:1783969265.296987:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280520832 00000100:00100000:0.0:1783969265.296994:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280520832 00000100:00100000:0.0:1783969265.297029:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783969265.297035:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a6cc73d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+10:5774:x1870627280520832:12345-0@lo:101: 00010000:00010000:0.0:1783969265.297046:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969265.297072:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d49339f9/0xbacf56d076faaac4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faaabd expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969265.297094:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d49339f9/0xbacf56d076faaac4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faaabd expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969265.297103:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d49339f9/0xbacf56d076faaac4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faaabd expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969265.297111:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d49339f9, rc 0) 00000100:00100000:0.0:1783969265.297152:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a6cc73d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+11:5774:x1870627280520832:12345-0@lo:101: Request processed in 116us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969265.297158:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783969265.297387:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000adb64e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280520832:0@lo:101: 00010000:00010000:2.0:1783969265.297401:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 00000000b70c2217/0xbacf56d076faaabd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaac4 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969265.297408:0:5774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 00000000b70c2217/0xbacf56d076faaabd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faaac4 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969265.297471:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000adb64e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280520960:0@lo:501: 00000100:00100000:2.0:1783969265.297496:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969265.297563:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 0000000097904353 going to sleep for 11 seconds 00000100:00100000:3.0:1783969265.297600:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280520960 00000100:00100000:3.0:1783969265.297605:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280520960 00000100:00100000:3.0:1783969265.297635:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783969265.297641:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000637bf58e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+11:5774:x1870627280520960:12345-0@lo:501: 00000100:00100000:2.0:1783969265.301137:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000637bf58e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+11:5774:x1870627280520960:12345-0@lo:501: Request processed in 3492us (3636us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969265.301152:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783969265.303111:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000adb64e8e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280520960:0@lo:501: 00000100:00100000:0.0:1783969265.303170:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000653d0420 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280521088:0@lo:503: 00000100:00100000:0.0:1783969265.303240:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969265.303333:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 000000001e5a5f24 going to sleep for 11 seconds 00000100:00100000:0.0:1783969265.304032:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280521088 00000100:00100000:0.0:1783969265.304041:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280521088 00000100:00100000:0.0:1783969265.304125:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783969265.304132:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003279312e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+11:5774:x1870627280521088:12345-0@lo:503: 00000040:00080000:0.0:1783969265.304182:0:5787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783969265.304244:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003279312e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+11:5774:x1870627280521088:12345-0@lo:503: Request processed in 113us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969265.304252:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783969265.304326:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000653d0420 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280521088:0@lo:503: 00000040:00080000:1.0:1783969265.305150:0:5821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1783969265.305291:0:5774:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1783969265.305311:0:5774:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783969265.305332:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 00000000b70c2217/0xbacf56d076faaabd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaac4 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969265.305343:0:5774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: 00000000b70c2217/0xbacf56d076faaabd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaac4 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969265.305380:0:5774:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783969265.305382:0:5774:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ac783021000 10000000:01000000:3.0:1783969265.305385:0:5774:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ac783021000 10000000:01000000:3.0:1783969265.305388:0:5774:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783969265.305391:0:5774:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ac783021000 from 1 10000000:01000000:3.0:1783969265.305393:0:5774:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783969265.305416:0:5774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 00000000e40bea74/0xbacf56d076faaacb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969265.305424:0:5774:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: 00000000e40bea74/0xbacf56d076faaacb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969265.305433:0:5774:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 00000000e40bea74/0xbacf56d076faaacb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969265.305458:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000045e8bf8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280521216:0@lo:101: 00000100:00100000:3.0:1783969265.305500:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969265.305535:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ec92ae36 going to sleep for 11 seconds 00000100:00100000:0.0:1783969265.305620:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280521216 00000100:00100000:0.0:1783969265.305627:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280521216 00000100:00100000:0.0:1783969265.305691:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783969265.305698:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002bb18eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+11:5774:x1870627280521216:12345-0@lo:101: 00010000:00010000:0.0:1783969265.305708:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969265.305720:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000070791dd9/0xbacf56d076faaad2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faaacb expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969265.305739:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000070791dd9/0xbacf56d076faaad2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faaacb expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969265.305749:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000070791dd9/0xbacf56d076faaad2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faaacb expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969265.305757:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000070791dd9, rc 0) 00000100:00100000:0.0:1783969265.305796:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002bb18eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+12:5774:x1870627280521216:12345-0@lo:101: Request processed in 99us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969265.305803:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783969265.305890:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000045e8bf8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280521216:0@lo:101: 00010000:00010000:3.0:1783969265.305902:0:5774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 00000000e40bea74/0xbacf56d076faaacb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaad2 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969265.305910:0:5774:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 00000000e40bea74/0xbacf56d076faaacb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faaad2 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969265.305949:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000045e8bf8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280521344:0@lo:501: 00000100:00100000:3.0:1783969265.305972:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969265.306322:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ec92ae36 going to sleep for 11 seconds 00000100:00100000:2.0:1783969265.306388:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280521344 00000100:00100000:2.0:1783969265.306393:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280521344 00000100:00100000:2.0:1783969265.306416:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783969265.306422:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010d5862e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+12:5774:x1870627280521344:12345-0@lo:501: 00000100:00100000:2.0:1783969265.306715:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010d5862e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+12:5774:x1870627280521344:12345-0@lo:501: Request processed in 293us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969265.306723:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783969265.306800:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000045e8bf8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280521344:0@lo:501: 00000100:00100000:3.0:1783969265.306832:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000045e8bf8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280521472:0@lo:503: 00000100:00100000:3.0:1783969265.306912:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969265.306923:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ec92ae36 going to sleep for 11 seconds 00000100:00100000:2.0:1783969265.307003:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280521472 00000100:00100000:2.0:1783969265.307008:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280521472 00000100:00100000:2.0:1783969265.307024:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783969265.307030:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a0104d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+12:5774:x1870627280521472:12345-0@lo:503: 00000100:00100000:2.0:1783969265.307320:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a0104d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+12:5774:x1870627280521472:12345-0@lo:503: Request processed in 289us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969265.307327:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783969265.307657:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000045e8bf8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280521472:0@lo:503: 00000100:00100000:3.0:1783969265.308095:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000045e8bf8c pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:5822:1870627280521600:0@lo:502: 00000100:00100000:3.0:1783969265.308142:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969265.308182:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 0000000024c63815 going to sleep for 11 seconds 00000100:00100000:0.0:1783969265.308398:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280521600 00000100:00100000:0.0:1783969265.308404:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280521600 00000100:00100000:0.0:1783969265.308437:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783969265.308444:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000333d319b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+12:5822:x1870627280521600:12345-0@lo:502: 00000100:00100000:0.0:1783969265.308683:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000333d319b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+12:5822:x1870627280521600:12345-0@lo:502: Request processed in 239us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969265.308690:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783969265.308903:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000045e8bf8c pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:5822:1870627280521600:0@lo:502: 00000020:01000004:3.0:1783969265.308957:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1783969265.308972:0:5822:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000027b1e907) 00000020:00000080:3.0:1783969265.308999:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1783969265.309158:0:5822:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000019027bbf from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783969265.309162:0:5822:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000019027bbf from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783969265.309165:0:5822:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000019027bbf 4 00010000:00080000:3.0:1783969265.309192:0:5822:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000eb00961c@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.139@tcp at head 00010000:00010000:2.0:1783969265.316118:0:5822:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1783969265.316211:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1783969265.316260:0:5822:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783969265.316272:0:5822:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xbacf56d076faaae0 00000100:00080000:2.0:1783969265.316281:0:5822:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783969265.316285:0:5822:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000eb00961c using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1783969265.316319:0:5822:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004cf29997 x1870627280521728/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783969265.316343:0:5822:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783969265.319337:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004cf29997 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1870627280521728:0@lo:38: 00000100:00100000:0.0:1783969265.319424:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969265.319580:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280521728 00000100:00100000:3.0:1783969265.319588:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280521728 00000100:00100000:3.0:1783969265.319633:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783969265.319638:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f9b9ca7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3284:x1870627280521728:12345-0@lo:38: 00000100:00100000:3.0:1783969265.319694:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f9b9ca7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3284:x1870627280521728:12345-0@lo:38: Request processed in 55us (270us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783969265.319700:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783969265.319816:0:3284:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783969265.319824:0:3284:0:(import.c:65:import_set_state_nolock()) 00000000eb00961c lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783969265.319828:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783969265.319831:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004cf29997 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1870627280521728:0@lo:38: 00000100:00100000:1.0:1783969265.319982:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a1799b57 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:5822:1870627280521856:0@lo:502: 00000100:00100000:1.0:1783969265.320025:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969265.320040:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 000000006cfad4df going to sleep for 11 seconds 00000100:00100000:0.0:1783969265.320103:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280521856 00000100:00100000:0.0:1783969265.320107:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280521856 00000100:00100000:0.0:1783969265.320133:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783969265.320138:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f80af7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+12:5822:x1870627280521856:12345-0@lo:502: 00000100:00100000:0.0:1783969265.320335:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f80af7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+12:5822:x1870627280521856:12345-0@lo:502: Request processed in 195us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969265.320342:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783969265.320565:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a1799b57 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:5822:1870627280521856:0@lo:502: 00000040:00080000:1.0:1783969265.320586:0:5822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1783969265.320710:0:5774:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1783969265.320729:0:5774:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783969265.320750:0:5774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 00000000e40bea74/0xbacf56d076faaacb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaad2 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969265.320761:0:5774:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: 00000000e40bea74/0xbacf56d076faaacb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaad2 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783969265.320805:0:5774:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783969265.320807:0:5774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783969265.320809:0:5774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783969265.320810:0:5774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783969265.320811:0:5774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783969265.320813:0:5774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783969265.320814:0:5774:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783969265.320815:0:5774:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783969265.320817:0:5774:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783969265.320819:0:5774:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783969265.320820:0:5774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783969265.320822:0:5774:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783969265.320826:0:5774:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1783969265.320834:0:5774:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783969265.320835:0:5774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783969265.320836:0:5774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783969265.320837:0:5774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783969265.320838:0:5774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783969265.320839:0:5774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783969265.320839:0:5774:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783969265.320840:0:5774:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783969265.320841:0:5774:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783969265.320842:0:5774:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783969265.320843:0:5774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783969265.320844:0:5774:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783969265.320856:0:5774:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783969265.320895:0:5774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000045e8bf8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280521984:0@lo:253: 00000100:00100000:3.0:1783969265.320927:0:5774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969265.320949:0:5774:0:(client.c:2702:ptlrpc_set_wait()) set 000000005ab9f450 going to sleep for 11 seconds 00000100:00100000:1.0:1783969265.325401:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280521984 00000100:00100000:1.0:1783969265.325415:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280521984 00000100:00100000:1.0:1783969265.325475:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783969265.325485:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a15b5231 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+12:5774:x1870627280521984:12345-0@lo:253: 20000000:01000000:1.0:1783969265.325518:0:5787:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783969265.325531:0:5787:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783969265.368840:0:5787:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783969265.368882:0:5787:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1783969265.368931:0:5809:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783969265.368936:0:5809:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783969265.368955:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000fed2b4b2/0xbacf56d076faaae7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969265.368971:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006d6c1947/0xbacf56d076faaab6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faaaaf expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969265.368979:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000fed2b4b2/0xbacf56d076faaae7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969265.369012:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006d6c1947/0xbacf56d076faaab6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faaaaf expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969265.369025:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006d6c1947/0xbacf56d076faaab6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faaaaf expref: 12 pid: 5788 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969265.369066:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002b0ae1c9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5809:1870627280522112:0@lo:104: 00000100:00100000:0.0:1783969265.369125:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969265.369180:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set 0000000070661994 going to sleep for 11 seconds 00000100:00100000:2.0:1783969265.369272:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280522112 00000100:00100000:2.0:1783969265.369278:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280522112 00000100:00100000:2.0:1783969265.369324:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783969265.369330:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2df566e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+3:5809:x1870627280522112:12345-0@lo:104: 00010000:00010000:2.0:1783969265.369341:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: 00000000c0c19316/0xbacf56d076faaaaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faaab6 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969265.369404:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783969265.369409:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2df566e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+3:5809:x1870627280522112:12345-0@lo:104: Request processed in 79us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969265.369416:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1783969265.369433:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969265.369437:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: 00000000c0c19316/0xbacf56d076faaaaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faaab6 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969265.369444:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c0c19316 already unused, calling callback (00000000e0e8bb5b) 10000000:00010000:2.0:1783969265.369447:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: 00000000c0c19316/0xbacf56d076faaaaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faaab6 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969265.369454:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: 00000000c0c19316/0xbacf56d076faaaaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faaab6 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783969265.369460:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: 00000000c0c19316/0xbacf56d076faaaaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faaab6 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969265.369475:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783969265.369500:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: 00000000c0c19316/0xbacf56d076faaaaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faaab6 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969265.369507:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783969265.369521:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: 00000000c0c19316/0xbacf56d076faaaaf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faaab6 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969265.369528:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: 00000000c0c19316/0xbacf56d076faaaaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faaab6 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969265.369542:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969265.369544:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969265.369545:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969265.369597:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008321e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280522240:0@lo:103: 00000100:00100000:2.0:1783969265.369625:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969265.369681:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280522240 00000100:00100000:2.0:1783969265.369685:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280522240 00010000:00010000:2.0:1783969265.369698:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006d6c1947/0xbacf56d076faaab6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faaaaf expref: 13 pid: 5788 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969265.369717:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783969265.369722:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000058c36f9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c893ad09-f78f-4711-bea5-6489668294ed+13:3286:x1870627280522240:12345-0@lo:103: 00010000:00010000:2.0:1783969265.369730:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969265.369734:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006d6c1947/0xbacf56d076faaab6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faaaaf expref: 13 pid: 5788 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969265.369743:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006d6c1947/0xbacf56d076faaab6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faaaaf expref: 13 pid: 5788 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969265.369763:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000fed2b4b2/0xbacf56d076faaae7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969265.369769:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fed2b4b2/0xbacf56d076faaae7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783969265.369780:0:5778:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000845155s 00010000:00010000:2.0:1783969265.369783:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fed2b4b2/0xbacf56d076faaae7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969265.369790:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fed2b4b2/0xbacf56d076faaae7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969265.369795:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000fed2b4b2/0xbacf56d076faaae7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969265.369801:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000fed2b4b2/0xbacf56d076faaae7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969265.369806:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fed2b4b2 already unused, calling callback (000000001ed8b2cd) 00010000:00010000:2.0:1783969265.369809:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000fed2b4b2/0xbacf56d076faaae7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969265.369814:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000fed2b4b2/0xbacf56d076faaae7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969265.369822:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000fed2b4b2/0xbacf56d076faaae7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969265.369829:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969265.369854:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000058c36f9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c893ad09-f78f-4711-bea5-6489668294ed+13:3286:x1870627280522240:12345-0@lo:103: Request processed in 132us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969265.369906:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783969265.369944:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008321e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280522240:0@lo:103: 00010000:00010000:3.0:1783969265.370085:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006d6c1947/0xbacf56d076faaab6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faaaaf expref: 12 pid: 5788 timeout: 272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969265.370095:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002b0ae1c9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5809:1870627280522112:0@lo:104: 00010000:00010000:3.0:1783969265.370107:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000fed2b4b2/0xbacf56d076faaae7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969265.370114:0:5809:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000fed2b4b2/0xbacf56d076faaae7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969265.370119:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000fed2b4b2/0xbacf56d076faaae7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969265.370123:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fed2b4b2/0xbacf56d076faaae7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969265.385075:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a15b5231 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+11:5774:x1870627280521984:12345-0@lo:253: Request processed in 59585us (64141us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969265.385092:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783969265.385189:0:5774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000045e8bf8c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:5774:1870627280521984:0@lo:253: 10000000:01000000:2.0:1783969265.385203:0:5774:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783969265.385206:0:5774:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783969265.385208:0:5774:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783969265.385209:0:5774:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969265.385210:0:5774:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969265.385211:0:5774:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969265.385213:0:5774:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969265.385214:0:5774:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783969265.385215:0:5774:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783969265.385217:0:5774:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783969265.385218:0:5774:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783969265.385219:0:5774:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969265.385220:0:5774:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783969265.385232:0:5774:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783969265.390541:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1783969265.390951:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783969265.391193:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1783969265.391361:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783969265.391553:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1783969265.391718:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1783969265.392957:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1783969265.393164:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1783969265.393455:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1783969265.393622:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1783969265.393824:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1783969265.394120:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1783969265.440757:0:5774:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1783969265.486020:0:5774:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1783969265.486311:0:5828:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1783969265.488844:0:5774:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1783969265.489040:0:5774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1783969265.489485:0:5774:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783969265.489491:0:5774:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1783969265.489605:0:5774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1783969265.492689:0:5827:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1783969265.492712:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:3.0:1783969265.506917:0:5774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1783969265.511746:0:5774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783969265.511825:0:5774:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1783969265.512316:0:5774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1783969265.517244:0:5774:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1783969265.518630:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1783969265.518770:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1783969265.518957:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1783969265.519102:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1783969265.519240:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1783969265.519369:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1783969265.519518:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1783969265.519674:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1783969265.519819:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1783969265.520003:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1783969265.521840:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1783969265.522028:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1783969265.522191:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1783969265.522320:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1783969265.522471:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1783969265.522624:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1783969265.522983:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1783969265.523130:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1783969265.523289:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1783969265.523421:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1783969265.523560:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1783969265.523690:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1783969265.523837:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1783969265.524016:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1783969265.524172:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1783969265.524305:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1783969265.524441:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1783969265.524584:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1783969265.524767:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1783969265.524926:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1783969265.530023:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1783969265.530293:0:5774:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1783969265.532005:0:5774:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1783969265.542401:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1783969265.588103:0:5774:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1783969265.588135:0:5774:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc0f301ca7988 00100000:10000000:3.0:1783969265.588142:0:5774:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1783969265.590201:0:5774:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783969265.590232:0:5774:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.139@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783969265.590246:0:5774:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1783969265.590264:0:5774:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1783969265.634304:0:5828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783969265.634385:0:5828:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783969265.634390:0:5828:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1783969266.213439:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969267.238054:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969268.262401:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969269.290751:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969270.325497:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783969270.377284:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1783969270.377295:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783969270.377297:0:37:0:(import.c:65:import_set_state_nolock()) 00000000eb00961c lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783969270.377310:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000eb00961c using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783969270.377332:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000213eb63c x1870627280522496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783969270.377428:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783969270.377441:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003891aea7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280522368:0@lo:400: 00000100:00100000:0.0:1783969270.377507:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969270.379640:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000213eb63c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1870627280522496:0@lo:38: 00000100:00100000:0.0:1783969270.379743:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969270.379878:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280522496 00000100:00100000:2.0:1783969270.379886:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280522496 00000100:00100000:2.0:1783969270.379921:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783969270.379928:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045a0eb8e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3284:x1870627280522496:12345-0@lo:38: 00010000:00080000:2.0:1783969270.379954:0:5795:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 127 last 0 00000020:00000080:2.0:1783969270.379988:0:5795:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xbacf56d076faaaee 00000004:00100000:2.0:1783969270.380051:0:5795:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783969270.380170:0:5795:0:(import.c:65:import_set_state_nolock()) 00000000d01d47b7 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783969270.380219:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045a0eb8e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1870627280522496:12345-0@lo:38: Request processed in 290us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969270.380299:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783969270.380974:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280522368 00000100:00100000:3.0:1783969270.380982:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280522368 00000100:00100000:3.0:1783969270.381038:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783969270.381055:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f12098f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+11:3288:x1870627280522368:12345-0@lo:400: 00000100:00100000:3.0:1783969270.381190:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f12098f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+11:3288:x1870627280522368:12345-0@lo:400: Request processed in 138us (3683us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969270.381198:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783969270.381323:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003891aea7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280522368:0@lo:400: 00010000:00080000:0.0:1783969270.383630:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000213eb63c x1870627280522496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783969280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783969270.383649:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1783969270.383678:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1783969270.383683:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783969270.383686:0:3284:0:(import.c:65:import_set_state_nolock()) 00000000eb00961c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783969270.383692:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000213eb63c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1870627280522496:0@lo:38: 00000001:02000400:1.0:1783969270.650503:0:6071:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783969271.335179:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969272.357094:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783969272.424361:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783969272.424369:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ac783021000 from 3 10000000:01000000:0.0:1783969272.424373:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783969272.424420:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 00000000fed2b4b2/0xbacf56d076faaaf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969272.424434:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: 00000000fed2b4b2/0xbacf56d076faaaf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969272.424444:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 00000000fed2b4b2/0xbacf56d076faaaf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969272.424467:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000213eb63c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280522624:0@lo:101: 00000100:00100000:0.0:1783969272.425637:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969272.425693:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c8588cd5 going to sleep for 11 seconds 00000100:00100000:2.0:1783969272.427423:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280522624 00000100:00100000:2.0:1783969272.427437:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280522624 00000100:00100000:2.0:1783969272.427495:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783969272.427504:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b99941a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+11:5790:x1870627280522624:12345-0@lo:101: 00010000:00010000:2.0:1783969272.427530:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969272.427551:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e0222c02/0xbacf56d076faaafc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faaaf5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969272.427576:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e0222c02/0xbacf56d076faaafc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faaaf5 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969272.427599:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e0222c02/0xbacf56d076faaafc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faaaf5 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969272.427607:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e0222c02, rc 0) 00000100:00100000:2.0:1783969272.427668:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b99941a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+12:5790:x1870627280522624:12345-0@lo:101: Request processed in 165us (2035us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969272.427675:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783969272.427722:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000213eb63c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280522624:0@lo:101: 00010000:00010000:2.0:1783969272.427738:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 00000000fed2b4b2/0xbacf56d076faaaf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaafc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969272.427746:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 00000000fed2b4b2/0xbacf56d076faaaf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faaafc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969272.427797:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008321e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280522752:0@lo:256: 00000100:00100000:2.0:1783969272.427829:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969272.427851:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set 000000009bee8d7f going to sleep for 11 seconds 00000100:00100000:2.0:1783969272.427882:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280522752 00000100:00100000:2.0:1783969272.427885:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280522752 00000100:00100000:2.0:1783969272.427904:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783969272.427909:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3a5f28e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+12:5790:x1870627280522752:12345-0@lo:256: 20000000:01000000:2.0:1783969272.427921:0:5788:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783969272.427934:0:5788:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783969272.427936:0:5788:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1783969272.427996:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3a5f28e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+12:5790:x1870627280522752:12345-0@lo:256: Request processed in 87us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969272.428002:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783969272.428043:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008321e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280522752:0@lo:256: 10000000:01000000:2.0:1783969272.428082:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783969272.428087:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 00000000fed2b4b2/0xbacf56d076faaaf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaafc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969272.428095:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: 00000000fed2b4b2/0xbacf56d076faaaf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaafc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969273.381134:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969274.409020:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969275.431486:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783969275.462528:0:6273:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc52d02df0 20000000:00000080:3.0:1783969275.462546:0:6273:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ac7ba0f6400 uarg=0000000000000000 20000000:01000000:3.0:1783969275.462578:0:6273:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1783969275.462585:0:6273:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1783969275.462589:0:6273:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1783969275.462774:0:6273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1783969275.462785:0:6273:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1783969275.481031:0:6273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783969275.481294:0:6273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1783969275.481367:0:6273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1783969275.481424:0:6273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1783969275.481451:0:6273:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783969275.481468:0:6273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a3698895/0xbacf56d076faab03 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969275.481484:0:6273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d49339f9/0xbacf56d076faaac4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faaabd expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969275.481491:0:6273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a3698895/0xbacf56d076faab03 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969275.481525:0:6273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d49339f9/0xbacf56d076faaac4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faaabd expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969275.481537:0:6273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d49339f9/0xbacf56d076faaac4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faaabd expref: 11 pid: 5788 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969275.481549:0:6273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008321e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6273:1870627280522880:0@lo:104: 00000100:00100000:2.0:1783969275.481615:0:6273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969275.481681:0:6273:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f6f4d7c4 going to sleep for 11 seconds 00000100:00100000:1.0:1783969275.481806:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280522880 00000100:00100000:1.0:1783969275.481814:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280522880 00000100:00100000:1.0:1783969275.481880:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783969275.481889:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044e9e442 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c893ad09-f78f-4711-bea5-6489668294ed+3:6273:x1870627280522880:12345-0@lo:104: 00010000:00010000:1.0:1783969275.481901:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: 00000000b70c2217/0xbacf56d076faaabd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faaac4 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969275.481964:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783969275.481969:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044e9e442 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c893ad09-f78f-4711-bea5-6489668294ed+3:6273:x1870627280522880:12345-0@lo:104: Request processed in 83us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969275.481976:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783969275.481999:0:6273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008321e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6273:1870627280522880:0@lo:104: 00010000:00010000:1.0:1783969275.482003:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969275.482007:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: 00000000b70c2217/0xbacf56d076faaabd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faaac4 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969275.482015:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b70c2217 already unused, calling callback (00000000e0e8bb5b) 00010000:00010000:3.0:1783969275.482016:0:6273:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a3698895/0xbacf56d076faab03 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783969275.482018:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: 00000000b70c2217/0xbacf56d076faaabd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faaac4 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969275.482025:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: 00000000b70c2217/0xbacf56d076faaabd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faaac4 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783969275.482031:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: 00000000b70c2217/0xbacf56d076faaabd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faaac4 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969275.482036:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783969275.482068:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: 00000000b70c2217/0xbacf56d076faaabd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faaac4 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969275.482085:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783969275.482103:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: 00000000b70c2217/0xbacf56d076faaabd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faaac4 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969275.482108:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a1799b57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280523008:0@lo:103: 00010000:00010000:1.0:1783969275.482109:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: 00000000b70c2217/0xbacf56d076faaabd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faaac4 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969275.482123:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969275.482124:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969275.482126:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969275.482137:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969275.482715:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280523008 00000100:00100000:1.0:1783969275.482721:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280523008 00010000:00010000:1.0:1783969275.482740:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d49339f9/0xbacf56d076faaac4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faaabd expref: 12 pid: 5788 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969275.485541:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783969275.485560:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b617064b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c893ad09-f78f-4711-bea5-6489668294ed+12:3288:x1870627280523008:12345-0@lo:103: 00010000:00010000:2.0:1783969275.485580:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969275.485600:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d49339f9/0xbacf56d076faaac4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faaabd expref: 12 pid: 5788 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969275.485616:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d49339f9/0xbacf56d076faaac4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faaabd expref: 12 pid: 5788 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969275.485634:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d49339f9/0xbacf56d076faaac4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faaabd expref: 12 pid: 5788 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969275.485651:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a3698895/0xbacf56d076faab03 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969275.485658:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a3698895/0xbacf56d076faab03 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969275.485674:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a3698895/0xbacf56d076faab03 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969275.485680:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a3698895/0xbacf56d076faab03 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969275.485685:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a3698895/0xbacf56d076faab03 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969275.485691:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a3698895/0xbacf56d076faab03 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969275.485713:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a3698895 already unused, calling callback (000000001ed8b2cd) 00010000:00010000:2.0:1783969275.485717:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a3698895/0xbacf56d076faab03 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969275.485724:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a3698895/0xbacf56d076faab03 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969275.493264:0:6273:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a3698895/0xbacf56d076faab03 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969275.493286:0:6273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a3698895/0xbacf56d076faab03 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969275.493409:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d90c5fa7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1870627280523136:0@lo:400: 00000100:00100000:0.0:1783969275.494314:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969275.494370:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280523136 00000100:00100000:1.0:1783969275.494379:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280523136 00000100:00100000:1.0:1783969275.494443:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783969275.494451:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e854525f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1870627280523136:12345-0@lo:400: 00000100:00100000:1.0:1783969275.494508:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e854525f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1870627280523136:12345-0@lo:400: Request processed in 58us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969275.494515:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783969275.495087:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d90c5fa7 x1870627280523136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969275.495101:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d90c5fa7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1870627280523136:0@lo:400: 00010000:00010000:2.0:1783969275.497142:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a3698895/0xbacf56d076faab03 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969275.497161:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a3698895/0xbacf56d076faab03 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969275.497183:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969275.497257:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b617064b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c893ad09-f78f-4711-bea5-6489668294ed+11:3288:x1870627280523008:12345-0@lo:103: Request processed in 11704us (15118us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969275.497267:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783969275.497349:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a1799b57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280523008:0@lo:103: 00010000:00010000:0.0:1783969276.456067:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969277.477028:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969278.503928:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969279.526106:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969280.552065:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969280.613402:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d90c5fa7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280523264:0@lo:400: 00000100:00100000:0.0:1783969280.613474:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969280.613537:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002ddf773e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280523392:0@lo:400: 00000100:00100000:0.0:1783969280.613564:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969280.613597:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280523264 00000100:00100000:0.0:1783969280.613618:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280523264 00000100:00100000:0.0:1783969280.613663:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783969280.613671:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000817aa558 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+11:3286:x1870627280523264:12345-0@lo:400: 00000100:00100000:0.0:1783969280.613718:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000817aa558 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+11:3286:x1870627280523264:12345-0@lo:400: Request processed in 49us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969280.613725:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783969280.613762:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280523392 00000100:00100000:0.0:1783969280.613766:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280523392 00000100:00100000:0.0:1783969280.613793:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783969280.613798:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049f0c821 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280523392:12345-0@lo:400: 00000100:00100000:0.0:1783969280.613832:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049f0c821 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280523392:12345-0@lo:400: Request processed in 34us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969280.613839:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783969280.613892:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002ddf773e x1870627280523392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969280.613906:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002ddf773e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280523392:0@lo:400: 00000100:00100000:0.0:1783969280.613932:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d90c5fa7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280523264:0@lo:400: 00000020:01000004:0.0:1783969280.835707:0:6590:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1783969280.835711:0:6590:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1783969280.835851:0:6590:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000073180067 00000020:01000004:0.0:1783969280.835920:0:6590:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1783969280.835933:0:6590:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1783969280.835947:0:6590:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000e8930aa3) 00000020:00000080:0.0:1783969280.836111:0:6590:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1783969280.883784:0:6590:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1783969280.885257:0:6590:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1783969280.954107:0:6590:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1783969280.965119:0:6590:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783969280.965152:0:6590:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1783969280.965211:0:6590:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783969280.965237:0:6590:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1783969280.965835:0:6590:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1783969280.965846:0:6590:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783969280.965856:0:6590:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbacf56d076faab11 00000020:01000004:2.0:1783969280.965864:0:6590:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1783969280.965884:0:6590:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.139@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783969280.965893:0:6590:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783969280.965898:0:6590:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1783969280.965902:0:6590:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1783969280.965912:0:6590:0:(genops.c:413:class_newdev()) Allocate new device OSS (000000001976999e) 00000020:00000080:2.0:1783969280.965950:0:6590:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1783969280.968023:0:6590:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783969280.968760:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1783969280.968768:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1783969280.973539:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1783969280.973555:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1783969280.974424:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1783969280.974432:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1783969280.976562:0:6590:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783969280.976936:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1783969280.976947:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1783969280.977825:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1783969280.977834:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1783969281.010440:0:6590:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783969281.010647:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1783969281.010653:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1783969281.013550:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783969281.013564:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1783969281.014532:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1783969281.014542:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1783969281.018634:0:6590:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783969281.018806:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1783969281.018812:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1783969281.019784:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1783969281.019794:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1783969281.104166:0:6590:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783969281.104361:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1783969281.104367:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1783969281.111626:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1783969281.111640:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1783969281.112209:0:6590:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1783969281.112236:0:6590:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1783969281.112242:0:6590:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.139@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1783969281.138167:0:6590:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.139@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783969281.138204:0:6590:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.139@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1783969281.138208:0:6590:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783969281.138210:0:6590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783969281.138211:0:6590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783969281.138212:0:6590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783969281.138214:0:6590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783969281.138215:0:6590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783969281.138337:0:6590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783969281.138339:0:6590:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783969281.138341:0:6590:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783969281.138342:0:6590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783969281.138343:0:6590:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783969281.138347:0:6590:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1783969281.138349:0:6590:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783969281.138351:0:6590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783969281.138352:0:6590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783969281.138352:0:6590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783969281.138353:0:6590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783969281.138355:0:6590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783969281.138355:0:6590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783969281.138356:0:6590:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783969281.138357:0:6590:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783969281.138358:0:6590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783969281.138359:0:6590:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783969281.138383:0:6590:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1783969281.138399:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d90c5fa7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280523520:0@lo:253: 00000100:00100000:0.0:1783969281.138625:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969281.138729:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c0020c9b going to sleep for 11 seconds 00000100:00100000:2.0:1783969281.138810:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280523520 00000100:00100000:2.0:1783969281.138817:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280523520 00000100:00100000:2.0:1783969281.138918:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783969281.138927:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063daac46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+11:6590:x1870627280523520:12345-0@lo:253: 20000000:01000000:2.0:1783969281.138976:0:5788:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1783969281.138981:0:5788:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1783969281.138986:0:5788:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1783969281.138989:0:5788:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1783969281.141197:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783969281.141425:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1783969281.141440:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1783969281.141480:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1783969281.141488:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1783969281.141519:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1783969281.141568:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1783969281.142008:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1783969281.142028:0:5788:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.139@tcp 20000000:01000000:3.0:1783969281.142030:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.139@tcp (null) (null) (null) 00000040:00080000:3.0:1783969281.142067:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1783969281.142076:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1783969281.142127:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1783969281.142135:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.139@tcp (null) (null) 00000040:00080000:3.0:1783969281.142167:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1783969281.142176:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1783969281.142205:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1783969281.142253:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1783969281.142980:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1783969281.142998:0:5788:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.139@tcp 20000000:01000000:3.0:1783969281.143000:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.139@tcp (null) (null) (null) 00000040:00080000:3.0:1783969281.143036:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1783969281.143045:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1783969281.143077:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1783969281.143084:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.139@tcp (null) (null) 00000040:00080000:3.0:1783969281.143142:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1783969281.143151:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1783969281.143183:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1783969281.143219:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1783969281.143234:0:5788:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1783969281.143242:0:5788:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1783969281.143247:0:5788:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1783969281.143249:0:5788:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1783969281.143251:0:5788:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1783969281.143262:0:5788:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1783969281.143265:0:5788:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1783969281.143299:0:5788:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1783969281.143301:0:5788:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783969281.145558:0:6605:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1783969281.145634:0:6605:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1783969281.145691:0:6605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1783969281.146376:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1783969281.146419:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1783969281.146453:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1783969281.146465:0:5788:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1783969281.146467:0:5788:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783969281.147907:0:6606:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1783969281.148015:0:6606:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1783969281.148078:0:6606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1783969281.149355:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1783969281.149397:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1783969281.149469:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1783969281.149485:0:5788:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1783969281.149487:0:5788:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1783969281.150441:0:6607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1783969281.150674:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1783969281.150712:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1783969281.150771:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:1.0:1783969281.150790:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783969281.150806:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000028b09f52/0xbacf56d076faab1f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.150823:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f7c7bad3/0xbacf56d076faaa46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faaa3f expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.150829:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000030f741be/0xbacf56d076faaa62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faaa5b expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.150835:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000070791dd9/0xbacf56d076faaad2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faaacb expref: 11 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.151015:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000028b09f52/0xbacf56d076faab1f lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.151054:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000070791dd9/0xbacf56d076faaad2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faaacb expref: 11 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.151068:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000070791dd9/0xbacf56d076faaad2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faaacb expref: 11 pid: 5786 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969281.151081:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a1799b57 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5788:1870627280523648:0@lo:104: 00000100:00100000:1.0:1783969281.151318:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783969281.151427:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000030f741be/0xbacf56d076faaa62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faaa5b expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.151436:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000030f741be/0xbacf56d076faaa62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faaa5b expref: 11 pid: 5788 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969281.151445:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fc01d009 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5788:1870627280523776:0@lo:104: 00000100:00100000:1.0:1783969281.151467:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783969281.151681:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f7c7bad3/0xbacf56d076faaa46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faaa3f expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.151690:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f7c7bad3/0xbacf56d076faaa46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faaa3f expref: 11 pid: 5787 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969281.151698:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f2187177 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5788:1870627280523904:0@lo:104: 00000100:00100000:1.0:1783969281.151717:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969281.151749:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280523648 00000100:00100000:0.0:1783969281.151760:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280523648 00000100:00100000:0.0:1783969281.151788:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280523776 00000100:00100000:0.0:1783969281.151790:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280523776 00000100:00100000:0.0:1783969281.151801:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783969281.151807:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d2795e5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c893ad09-f78f-4711-bea5-6489668294ed+4:5788:x1870627280523648:12345-0@lo:104: 00010000:00010000:0.0:1783969281.151816:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: 00000000e40bea74/0xbacf56d076faaacb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faaad2 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.151891:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783969281.151896:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d2795e5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c893ad09-f78f-4711-bea5-6489668294ed+4:5788:x1870627280523648:12345-0@lo:104: Request processed in 90us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969281.151902:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783969281.151916:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783969281.151921:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029b59f01 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c893ad09-f78f-4711-bea5-6489668294ed+3:5788:x1870627280523776:12345-0@lo:104: 00010000:00010000:0.0:1783969281.151927:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: 000000007733b021/0xbacf56d076faaa5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faaa62 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.151969:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783969281.151973:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029b59f01 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c893ad09-f78f-4711-bea5-6489668294ed+3:5788:x1870627280523776:12345-0@lo:104: Request processed in 53us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969281.151979:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1783969281.151995:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783969281.152000:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: 00000000e40bea74/0xbacf56d076faaacb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faaad2 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.152007:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e40bea74 already unused, calling callback (00000000e0e8bb5b) 10000000:00010000:0.0:1783969281.152009:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: 00000000e40bea74/0xbacf56d076faaacb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faaad2 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.152029:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: 00000000e40bea74/0xbacf56d076faaacb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faaad2 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969281.152036:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: 00000000e40bea74/0xbacf56d076faaacb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faaad2 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969281.152040:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783969281.152068:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: 00000000e40bea74/0xbacf56d076faaacb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faaad2 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.152074:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969281.152087:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: 00000000e40bea74/0xbacf56d076faaacb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faaad2 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.152092:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: 00000000e40bea74/0xbacf56d076faaacb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faaad2 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.152103:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969281.152105:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: 000000007733b021/0xbacf56d076faaa5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faaa62 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.152109:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007733b021 already unused, calling callback (00000000e0e8bb5b) 10000000:00010000:0.0:1783969281.152110:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: 000000007733b021/0xbacf56d076faaa5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faaa62 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.152115:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: 000000007733b021/0xbacf56d076faaa5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faaa62 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969281.152119:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: 000000007733b021/0xbacf56d076faaa5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faaa62 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969281.152129:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783969281.152139:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: 000000007733b021/0xbacf56d076faaa5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faaa62 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.152143:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969281.152151:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: 000000007733b021/0xbacf56d076faaa5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faaa62 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.152169:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: 000000007733b021/0xbacf56d076faaa5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faaa62 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.152179:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969281.152180:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969281.152181:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969281.152197:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002ddf773e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280524032:0@lo:103: 00000100:00100000:0.0:1783969281.152223:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969281.152255:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b0237fd3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280524160:0@lo:103: 00000100:00100000:0.0:1783969281.152286:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969281.152325:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280524032 00000100:00100000:0.0:1783969281.152329:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280524032 00010000:00010000:0.0:1783969281.152345:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000070791dd9/0xbacf56d076faaad2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faaacb expref: 12 pid: 5786 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969281.152364:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280524160 00000100:00100000:0.0:1783969281.152367:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280524160 00010000:00010000:0.0:1783969281.152375:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000030f741be/0xbacf56d076faaa62 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faaa5b expref: 13 pid: 5788 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969281.152385:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783969281.152395:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ad8e889 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c893ad09-f78f-4711-bea5-6489668294ed+13:3288:x1870627280524032:12345-0@lo:103: 00010000:00010000:0.0:1783969281.152403:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969281.152407:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000070791dd9/0xbacf56d076faaad2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faaacb expref: 13 pid: 5786 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.152415:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000070791dd9/0xbacf56d076faaad2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faaacb expref: 13 pid: 5786 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.152429:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969281.152454:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ad8e889 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c893ad09-f78f-4711-bea5-6489668294ed+13:3288:x1870627280524032:12345-0@lo:103: Request processed in 59us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969281.152460:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783969281.152473:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783969281.152478:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048bf4bb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c893ad09-f78f-4711-bea5-6489668294ed+12:3285:x1870627280524160:12345-0@lo:103: 00010000:00010000:0.0:1783969281.152484:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969281.152488:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000030f741be/0xbacf56d076faaa62 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faaa5b expref: 12 pid: 5788 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.152495:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000030f741be/0xbacf56d076faaa62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faaa5b expref: 12 pid: 5788 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.152504:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969281.152526:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048bf4bb5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c893ad09-f78f-4711-bea5-6489668294ed+12:3285:x1870627280524160:12345-0@lo:103: Request processed in 49us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969281.152531:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783969281.152559:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002ddf773e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280524032:0@lo:103: 00000100:00100000:0.0:1783969281.152582:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b0237fd3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280524160:0@lo:103: 00010000:00010000:3.0:1783969281.152817:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969281.153078:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b9d112d3 going to sleep for 11 seconds 00010000:00010000:1.0:1783969281.153094:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000070791dd9/0xbacf56d076faaad2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faaacb expref: 11 pid: 5786 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969281.153113:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a1799b57 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5788:1870627280523648:0@lo:104: 00010000:00010000:1.0:1783969281.153125:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000030f741be/0xbacf56d076faaa62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faaa5b expref: 10 pid: 5788 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969281.153133:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fc01d009 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5788:1870627280523776:0@lo:104: 00000100:00100000:2.0:1783969281.153193:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280523904 00000100:00100000:2.0:1783969281.153199:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280523904 00000100:00100000:0.0:1783969281.153335:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783969281.153349:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000524aa7f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c893ad09-f78f-4711-bea5-6489668294ed+3:5788:x1870627280523904:12345-0@lo:104: 00010000:00010000:0.0:1783969281.153359:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: 00000000af71c796/0xbacf56d076faaa3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faaa46 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.153410:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783969281.153414:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000524aa7f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c893ad09-f78f-4711-bea5-6489668294ed+3:5788:x1870627280523904:12345-0@lo:104: Request processed in 68us (1697us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969281.153420:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1783969281.153464:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969281.153468:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: 00000000af71c796/0xbacf56d076faaa3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faaa46 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.153476:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000af71c796 already unused, calling callback (00000000e0e8bb5b) 10000000:00010000:3.0:1783969281.153478:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: 00000000af71c796/0xbacf56d076faaa3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faaa46 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.153484:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: 00000000af71c796/0xbacf56d076faaa3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faaa46 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969281.153489:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: 00000000af71c796/0xbacf56d076faaa3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faaa46 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969281.153495:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969281.153527:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: 00000000af71c796/0xbacf56d076faaa3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faaa46 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.153538:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969281.153554:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: 00000000af71c796/0xbacf56d076faaa3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faaa46 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.153560:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: 00000000af71c796/0xbacf56d076faaa3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faaa46 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.153572:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969281.153574:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969281.153575:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969281.153585:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ef49f424 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280524288:0@lo:103: 00000100:00100000:3.0:1783969281.153615:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969281.153646:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280524288 00000100:00100000:3.0:1783969281.153650:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280524288 00010000:00010000:3.0:1783969281.153665:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f7c7bad3/0xbacf56d076faaa46 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faaa3f expref: 10 pid: 5787 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969281.153682:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783969281.153687:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f8f7a4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c893ad09-f78f-4711-bea5-6489668294ed+10:3286:x1870627280524288:12345-0@lo:103: 00010000:00010000:3.0:1783969281.153695:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969281.153699:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f7c7bad3/0xbacf56d076faaa46 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faaa3f expref: 10 pid: 5787 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.153707:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f7c7bad3/0xbacf56d076faaa46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faaa3f expref: 10 pid: 5787 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.153721:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000028b09f52/0xbacf56d076faab1f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.153738:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000028b09f52/0xbacf56d076faab1f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.153752:0:5780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000028b09f52/0xbacf56d076faab1f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.153758:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000028b09f52/0xbacf56d076faab1f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.153764:0:5780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000028b09f52/0xbacf56d076faab1f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.153770:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000028b09f52/0xbacf56d076faab1f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.153774:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000028b09f52 already unused, calling callback (000000001ed8b2cd) 00010000:00010000:3.0:1783969281.153777:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000028b09f52/0xbacf56d076faab1f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.153783:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000028b09f52/0xbacf56d076faab1f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.153790:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000028b09f52/0xbacf56d076faab1f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.153799:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969281.153826:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f8f7a4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c893ad09-f78f-4711-bea5-6489668294ed+10:3286:x1870627280524288:12345-0@lo:103: Request processed in 139us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969281.153831:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783969281.153887:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ef49f424 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280524288:0@lo:103: 00010000:00010000:1.0:1783969281.153976:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f7c7bad3/0xbacf56d076faaa46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faaa3f expref: 9 pid: 5787 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969281.153986:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f2187177 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5788:1870627280523904:0@lo:104: 00010000:00010000:1.0:1783969281.154004:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000028b09f52/0xbacf56d076faab1f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.154011:0:5788:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000028b09f52/0xbacf56d076faab1f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.154016:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000028b09f52/0xbacf56d076faab1f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.154020:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000028b09f52/0xbacf56d076faab1f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783969281.154030:0:5788:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1783969281.247715:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063daac46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+8:6590:x1870627280523520:12345-0@lo:253: Request processed in 108783us (109084us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969281.247730:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783969281.247833:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d90c5fa7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280523520:0@lo:253: 10000000:01000000:2.0:1783969281.247845:0:6590:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783969281.247855:0:6590:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783969281.247879:0:6590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783969281.247880:0:6590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969281.247881:0:6590:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1783969281.247882:0:6590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969281.247883:0:6590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969281.247884:0:6590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783969281.247886:0:6590:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1783969281.247887:0:6590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969281.247888:0:6590:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783969281.248053:0:6590:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000073180067 from lustre-OST0000 10000000:01000000:2.0:1783969281.248103:0:6590:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1783969281.248105:0:6590:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783969281.248111:0:6590:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ac7917f19c0 local copy 10000000:01000000:2.0:1783969281.248115:0:6590:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783969281.248149:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 00000000ce790c04/0xbacf56d076faab26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969281.248221:0:6590:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.139@tcp lock: 00000000ce790c04/0xbacf56d076faab26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969281.248232:0:6590:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 00000000ce790c04/0xbacf56d076faab26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969281.248250:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000085e5a2ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280524416:0@lo:101: 00000100:00100000:2.0:1783969281.248361:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969281.248492:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c46ad345 going to sleep for 11 seconds 00000100:00100000:3.0:1783969281.248673:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280524416 00000100:00100000:3.0:1783969281.248679:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280524416 00000100:00100000:3.0:1783969281.248758:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783969281.248766:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b88178f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+8:6590:x1870627280524416:12345-0@lo:101: 00010000:00010000:3.0:1783969281.248778:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969281.248791:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005ca8fbd8/0xbacf56d076faab2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faab26 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.248825:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005ca8fbd8/0xbacf56d076faab2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faab26 expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.248836:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005ca8fbd8/0xbacf56d076faab2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faab26 expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.248844:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005ca8fbd8, rc 0) 00000100:00100000:3.0:1783969281.249278:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b88178f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+9:6590:x1870627280524416:12345-0@lo:101: Request processed in 512us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969281.249284:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783969281.249359:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000085e5a2ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280524416:0@lo:101: 00010000:00010000:2.0:1783969281.249372:0:6590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 00000000ce790c04/0xbacf56d076faab26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xbacf56d076faab2d expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969281.249380:0:6590:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 00000000ce790c04/0xbacf56d076faab26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbacf56d076faab2d expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969281.249517:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000085e5a2ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280524544:0@lo:501: 00000100:00100000:2.0:1783969281.249547:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969281.250197:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c46ad345 going to sleep for 11 seconds 00000100:00100000:0.0:1783969281.250394:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280524544 00000100:00100000:0.0:1783969281.250403:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280524544 00000100:00100000:2.0:1783969281.250516:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783969281.250525:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce653b9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+9:6590:x1870627280524544:12345-0@lo:501: 00000100:00100000:2.0:1783969281.250791:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce653b9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+9:6590:x1870627280524544:12345-0@lo:501: Request processed in 267us (1243us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783969281.250817:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783969281.251331:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000085e5a2ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280524544:0@lo:501: 10000000:01000000:0.0:1783969281.251364:0:6590:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783969281.251403:0:6590:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783969281.251409:0:6590:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 00000000ce790c04/0xbacf56d076faab26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbacf56d076faab2d expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.251419:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 00000000ce790c04/0xbacf56d076faab26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbacf56d076faab2d expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.251424:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: 00000000ce790c04/0xbacf56d076faab26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbacf56d076faab2d expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.251449:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783969281.251472:0:6590:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ac7ba5f7000 10000000:01000000:0.0:1783969281.251477:0:6590:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783969281.251482:0:6590:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ac7917f19c0 10000000:01000000:0.0:1783969281.251484:0:6590:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1783969281.251488:0:6590:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9ac7917f19c0 from 1 10000000:01000000:0.0:1783969281.251490:0:6590:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1783969281.251528:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 000000001c261994/0xbacf56d076faab34 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.251534:0:6590:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: 000000001c261994/0xbacf56d076faab34 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.251544:0:6590:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 000000001c261994/0xbacf56d076faab34 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969281.251561:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b0237fd3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280524672:0@lo:101: 00000100:00100000:0.0:1783969281.251601:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969281.251630:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fded200b going to sleep for 11 seconds 00000100:00100000:3.0:1783969281.251708:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280524672 00000100:00100000:3.0:1783969281.251716:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280524672 00000100:00100000:3.0:1783969281.251749:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783969281.251756:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007cd5ffe0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+9:6590:x1870627280524672:12345-0@lo:101: 00010000:00010000:3.0:1783969281.251767:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969281.251780:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d38543be/0xbacf56d076faab3b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faab34 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.251803:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d38543be/0xbacf56d076faab3b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faab34 expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.251835:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d38543be/0xbacf56d076faab3b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faab34 expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.251843:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d38543be, rc 0) 00000100:00100000:3.0:1783969281.252119:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007cd5ffe0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+10:6590:x1870627280524672:12345-0@lo:101: Request processed in 363us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969281.252126:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1783969281.252337:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969281.252343:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: 00000000ce790c04/0xbacf56d076faab26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xbacf56d076faab2d expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969281.252350:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ce790c04 already unused, calling callback (00000000e0e8bb5b) 10000000:00010000:2.0:1783969281.252353:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: 00000000ce790c04/0xbacf56d076faab26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xbacf56d076faab2d expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969281.252361:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: 00000000ce790c04/0xbacf56d076faab26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xbacf56d076faab2d expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783969281.252367:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: 00000000ce790c04/0xbacf56d076faab26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xbacf56d076faab2d expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969281.252372:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783969281.252391:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: 00000000ce790c04/0xbacf56d076faab26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbacf56d076faab2d expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969281.252397:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783969281.252423:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: 00000000ce790c04/0xbacf56d076faab26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbacf56d076faab2d expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969281.252430:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: 00000000ce790c04/0xbacf56d076faab26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xbacf56d076faab2d expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969281.252445:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969281.252447:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969281.252448:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969281.252455:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783969281.252474:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000efa1727b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280524800:0@lo:103: 00000100:00100000:2.0:1783969281.252503:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969281.252601:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b0237fd3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280524672:0@lo:101: 00010000:00010000:0.0:1783969281.252614:0:6590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 000000001c261994/0xbacf56d076faab34 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faab3b expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.252623:0:6590:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 000000001c261994/0xbacf56d076faab34 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faab3b expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969281.252640:0:6590:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1783969281.252657:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 000000001c261994/0xbacf56d076faab34 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faab3b expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.252663:0:6590:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: 000000001c261994/0xbacf56d076faab34 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faab3b expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969281.252671:0:6590:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1783969281.252674:0:6590:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783969281.252679:0:6590:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1783969281.252681:0:6590:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783969281.252703:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 0000000070791dd9/0xbacf56d076faab42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.252709:0:6590:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: 0000000070791dd9/0xbacf56d076faab42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.252715:0:6590:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 0000000070791dd9/0xbacf56d076faab42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969281.252725:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b0237fd3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280524928:0@lo:101: 00000100:00100000:0.0:1783969281.252748:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969281.252759:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fded200b going to sleep for 11 seconds 00000100:00100000:3.0:1783969281.253512:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280524800 00000100:00100000:3.0:1783969281.253520:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280524800 00000100:00100000:3.0:1783969281.253574:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783969281.253582:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5dc3e27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c893ad09-f78f-4711-bea5-6489668294ed+10:3288:x1870627280524800:12345-0@lo:103: 00010000:00010000:3.0:1783969281.253595:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969281.253611:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005ca8fbd8/0xbacf56d076faab2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbacf56d076faab26 expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.253629:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969281.253673:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5dc3e27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c893ad09-f78f-4711-bea5-6489668294ed+9:3288:x1870627280524800:12345-0@lo:103: Request processed in 92us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969281.253680:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783969281.253708:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000efa1727b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280524800:0@lo:103: 00000100:00100000:3.0:1783969281.253736:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280524928 00000100:00100000:3.0:1783969281.253740:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280524928 00000100:00100000:3.0:1783969281.253760:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783969281.253764:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae5ce4a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+9:6590:x1870627280524928:12345-0@lo:101: 00010000:00010000:3.0:1783969281.253774:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969281.253785:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000571ae24a/0xbacf56d076faab49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faab42 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.253821:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000571ae24a/0xbacf56d076faab49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faab42 expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.253829:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000571ae24a/0xbacf56d076faab49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faab42 expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.253836:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000571ae24a, rc 0) 00000100:00100000:3.0:1783969281.254062:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae5ce4a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+10:6590:x1870627280524928:12345-0@lo:101: Request processed in 297us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969281.254069:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783969281.254142:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b0237fd3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280524928:0@lo:101: 00010000:00010000:2.0:1783969281.254169:0:6590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 0000000070791dd9/0xbacf56d076faab42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faab49 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969281.254176:0:6590:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 0000000070791dd9/0xbacf56d076faab42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faab49 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969281.254417:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000021488e57 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280525056:0@lo:501: 00000100:00100000:2.0:1783969281.254452:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969281.254490:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set 00000000087ded60 going to sleep for 11 seconds 00000100:00100000:3.0:1783969281.254671:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280525056 00000100:00100000:3.0:1783969281.254676:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280525056 00000100:00100000:3.0:1783969281.254712:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783969281.254718:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085ac26c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+10:6590:x1870627280525056:12345-0@lo:501: 00000100:00100000:3.0:1783969281.255410:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085ac26c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+10:6590:x1870627280525056:12345-0@lo:501: Request processed in 691us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969281.255419:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783969281.255493:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000021488e57 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280525056:0@lo:501: 00000100:00100000:2.0:1783969281.255538:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000021488e57 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280525184:0@lo:503: 00000100:00100000:2.0:1783969281.255578:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969281.255608:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set 00000000087ded60 going to sleep for 11 seconds 00000100:00100000:3.0:1783969281.255647:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280525184 00000100:00100000:3.0:1783969281.255651:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280525184 00000100:00100000:3.0:1783969281.255680:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783969281.255686:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000936ba67b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+10:6590:x1870627280525184:12345-0@lo:503: 00000100:00100000:3.0:1783969281.256143:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000936ba67b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+10:6590:x1870627280525184:12345-0@lo:503: Request processed in 456us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969281.256151:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783969281.256400:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000021488e57 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280525184:0@lo:503: 00000040:00080000:2.0:1783969281.256675:0:6590:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783969281.258658:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000021488e57 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280525312:0@lo:502: 00000100:00100000:2.0:1783969281.258750:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969281.258839:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set 00000000087ded60 going to sleep for 11 seconds 00000100:00100000:3.0:1783969281.259329:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280525312 00000100:00100000:3.0:1783969281.259337:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280525312 00000100:00100000:3.0:1783969281.259431:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783969281.259449:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b47bb95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+10:6590:x1870627280525312:12345-0@lo:502: 00000100:00100000:3.0:1783969281.259690:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b47bb95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+10:6590:x1870627280525312:12345-0@lo:502: Request processed in 243us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969281.259698:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783969281.259791:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000021488e57 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280525312:0@lo:502: 00000040:00080000:0.0:1783969281.260707:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1783969281.260779:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1783969281.260832:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1783969281.261177:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1783969281.261220:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1783969281.261374:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1783969281.261418:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002ddf773e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280525440:0@lo:502: 00000100:00100000:0.0:1783969281.261485:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969281.261751:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set 000000006958d18e going to sleep for 11 seconds 00000100:00100000:2.0:1783969281.262164:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280525440 00000100:00100000:2.0:1783969281.262173:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280525440 00000100:00100000:2.0:1783969281.262215:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783969281.262222:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066860a89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+10:6590:x1870627280525440:12345-0@lo:502: 00000100:00100000:2.0:1783969281.262573:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066860a89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+10:6590:x1870627280525440:12345-0@lo:502: Request processed in 350us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969281.262587:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783969281.262704:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002ddf773e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280525440:0@lo:502: 00000040:00080000:0.0:1783969281.262875:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1783969281.262888:0:6590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1783969281.263759:0:6610:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783969281.263767:0:6610:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1783969281.263773:0:6610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969281.263776:0:6610:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1783969281.263781:0:6610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783969281.263796:0:6610:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (000000003c262f3e) 00000020:00000080:2.0:1783969281.263826:0:6610:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783969281.263833:0:6610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783969281.264185:0:6610:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000073180067 from lustre-OST0000, refs=2 00080000:01000000:2.0:1783969281.264194:0:6610:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783969281.264201:0:6610:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbacf56d076faab57 00010000:00010000:2.0:1783969281.271387:0:6610:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1783969281.271693:0:6610:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1783969281.279409:0:6610:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1783969281.279721:0:6610:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1783969281.290522:0:6610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1783969281.294598:0:6610:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1783969281.299943:0:6610:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1783969281.301123:0:6610:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969281.301134:0:6610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969281.301137:0:6610:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1783969281.301144:0:6610:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969281.301149:0:6610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969281.301151:0:6610:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783969281.301228:0:6610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783969281.301231:0:6610:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783969281.301357:0:6610:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969281.301361:0:6610:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969281.301363:0:6610:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783969281.301365:0:6610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1783969281.308494:0:6590:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1783969281.308534:0:6590:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783969281.309073:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: 0000000070791dd9/0xbacf56d076faab42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faab49 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.309101:0:6590:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: 0000000070791dd9/0xbacf56d076faab42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faab49 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969281.309109:0:6590:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ac7ba5f7000 from 1 10000000:01000000:0.0:1783969281.309111:0:6590:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783969281.309151:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: 00000000d49339f9/0xbacf56d076faab5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.309169:0:6590:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: 00000000d49339f9/0xbacf56d076faab5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.309180:0:6590:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: 00000000d49339f9/0xbacf56d076faab5e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969281.309204:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002ddf773e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280525568:0@lo:101: 00000100:00100000:0.0:1783969281.309349:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969281.309416:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fded200b going to sleep for 11 seconds 00000100:00100000:1.0:1783969281.311122:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280525568 00000100:00100000:1.0:1783969281.311137:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280525568 00000100:00100000:1.0:1783969281.311201:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783969281.311220:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000081d0b4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+10:6590:x1870627280525568:12345-0@lo:101: 00010000:00010000:1.0:1783969281.311237:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969281.311264:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000028b09f52/0xbacf56d076faab65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faab5e expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.311292:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000028b09f52/0xbacf56d076faab65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faab5e expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.311303:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000028b09f52/0xbacf56d076faab65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faab5e expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.311313:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000028b09f52, rc 0) 00000100:00100000:1.0:1783969281.311377:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000081d0b4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+11:6590:x1870627280525568:12345-0@lo:101: Request processed in 160us (2029us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969281.311393:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783969281.312031:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002ddf773e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280525568:0@lo:101: 00010000:00010000:0.0:1783969281.312048:0:6590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: 00000000d49339f9/0xbacf56d076faab5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faab65 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969281.312057:0:6590:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: 00000000d49339f9/0xbacf56d076faab5e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faab65 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969281.312187:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002ddf773e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280525696:0@lo:501: 00000100:00100000:0.0:1783969281.312226:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969281.312494:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280525696 00000100:00100000:3.0:1783969281.312500:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280525696 00000100:00100000:3.0:1783969281.312529:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783969281.312534:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009079b63a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+11:6590:x1870627280525696:12345-0@lo:501: 00000100:00100000:3.0:1783969281.312753:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009079b63a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+11:6590:x1870627280525696:12345-0@lo:501: Request processed in 218us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969281.312761:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783969281.312813:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fded200b going to sleep for 11 seconds 00000100:00100000:0.0:1783969281.312831:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002ddf773e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280525696:0@lo:501: 00000100:00100000:0.0:1783969281.312896:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002ddf773e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280525824:0@lo:503: 00000100:00100000:0.0:1783969281.312931:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969281.312946:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fded200b going to sleep for 11 seconds 00000100:00100000:1.0:1783969281.313128:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280525824 00000100:00100000:1.0:1783969281.313133:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280525824 00000100:00100000:1.0:1783969281.313163:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783969281.313169:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000134581f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+11:6590:x1870627280525824:12345-0@lo:503: 00000100:00100000:1.0:1783969281.313585:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000134581f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+11:6590:x1870627280525824:12345-0@lo:503: Request processed in 414us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969281.313592:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783969281.314104:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002ddf773e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280525824:0@lo:503: 00000040:00080000:0.0:1783969281.314799:0:6590:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783969281.315373:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002ddf773e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280525952:0@lo:502: 00000100:00100000:0.0:1783969281.315555:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969281.315617:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fded200b going to sleep for 11 seconds 00000100:00100000:1.0:1783969281.315658:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280525952 00000100:00100000:1.0:1783969281.315664:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280525952 00000100:00100000:1.0:1783969281.315730:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783969281.315738:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbb9240a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+11:6590:x1870627280525952:12345-0@lo:502: 00000100:00100000:1.0:1783969281.316001:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbb9240a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+11:6590:x1870627280525952:12345-0@lo:502: Request processed in 263us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969281.316019:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783969281.316095:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002ddf773e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280525952:0@lo:502: 00000040:00080000:0.0:1783969281.316375:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1783969281.316440:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1783969281.316467:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002ddf773e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280526080:0@lo:502: 00000100:00100000:0.0:1783969281.316503:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969281.317414:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fded200b going to sleep for 11 seconds 00000100:00100000:3.0:1783969281.317502:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280526080 00000100:00100000:3.0:1783969281.317508:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280526080 00000100:00100000:2.0:1783969281.317562:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783969281.317572:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002851442f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+11:6590:x1870627280526080:12345-0@lo:502: 00000100:00100000:2.0:1783969281.317769:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002851442f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+11:6590:x1870627280526080:12345-0@lo:502: Request processed in 200us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969281.317777:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783969281.317990:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002ddf773e pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280526080:0@lo:502: 00000040:00080000:0.0:1783969281.318108:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1783969281.318120:0:6590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1783969281.319465:0:6614:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969281.319477:0:6614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969281.319479:0:6614:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783969281.319486:0:6614:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac7ba5f7000 00000020:00000080:0.0:1783969281.319488:0:6614:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783969281.319525:0:6614:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969281.319528:0:6614:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969281.319530:0:6614:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1783969281.319532:0:6614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1783969281.319749:0:6590:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1783969281.319769:0:6590:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783969281.319814:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac780031800/0xbacf56d076faab5e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faab65 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969281.319825:0:6590:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac780031800/0xbacf56d076faab5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faab65 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969281.320247:0:6590:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783969281.320251:0:6590:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ac7ba5f7000 10000000:01000000:2.0:1783969281.320254:0:6590:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ac7ba5f7000 10000000:01000000:2.0:1783969281.320328:0:6590:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783969281.320336:0:6590:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ac7ba5f7000 from 1 10000000:01000000:2.0:1783969281.320338:0:6590:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783969281.320372:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faab6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969281.320381:0:6590:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faab6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969281.320466:0:6590:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faab6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969281.320488:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba613b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280526208:0@lo:101: 00000100:00100000:2.0:1783969281.320546:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969281.320623:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac791933c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969281.320667:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280526208 00000100:00100000:1.0:1783969281.320673:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280526208 00000100:00100000:1.0:1783969281.320774:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783969281.320783:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+11:6590:x1870627280526208:12345-0@lo:101: 00010000:00010000:1.0:1783969281.320795:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969281.320806:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac781496a00/0xbacf56d076faab73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faab6c expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.320826:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac781496a00/0xbacf56d076faab73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faab6c expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.320837:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac781496a00/0xbacf56d076faab73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faab6c expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.320846:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac781496a00, rc 0) 00000100:00100000:1.0:1783969281.320910:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+12:6590:x1870627280526208:12345-0@lo:101: Request processed in 128us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969281.320916:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783969281.320999:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba613b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280526208:0@lo:101: 00010000:00010000:2.0:1783969281.321013:0:6590:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faab6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faab73 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969281.321022:0:6590:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faab6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faab73 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969281.321117:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba613b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280526336:0@lo:501: 00000100:00100000:2.0:1783969281.321139:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969281.321598:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280526336 00000100:00100000:3.0:1783969281.321603:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280526336 00000100:00100000:3.0:1783969281.321626:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783969281.321638:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+12:6590:x1870627280526336:12345-0@lo:501: 00000100:00100000:3.0:1783969281.321827:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+12:6590:x1870627280526336:12345-0@lo:501: Request processed in 189us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969281.321834:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783969281.322003:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac791933c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783969281.322018:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba613b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280526336:0@lo:501: 00000100:00100000:2.0:1783969281.322050:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba613b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280526464:0@lo:503: 00000100:00100000:2.0:1783969281.322083:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969281.322102:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac791933c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783969281.322238:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280526464 00000100:00100000:3.0:1783969281.322242:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280526464 00000100:00100000:3.0:1783969281.322317:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783969281.322323:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+12:6590:x1870627280526464:12345-0@lo:503: 00000100:00100000:3.0:1783969281.322525:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+12:6590:x1870627280526464:12345-0@lo:503: Request processed in 202us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969281.322532:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783969281.322600:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba613b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280526464:0@lo:503: 00000040:00080000:2.0:1783969281.322832:0:6590:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783969281.323070:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba613b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280526592:0@lo:502: 00000100:00100000:2.0:1783969281.323111:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969281.323126:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac791933c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969281.323358:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280526592 00000100:00100000:1.0:1783969281.323363:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280526592 00000100:00100000:3.0:1783969281.323531:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783969281.323540:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+12:6590:x1870627280526592:12345-0@lo:502: 00000100:00100000:3.0:1783969281.323723:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+12:6590:x1870627280526592:12345-0@lo:502: Request processed in 184us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969281.323731:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783969281.324547:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba613b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280526592:0@lo:502: 00000040:00080000:2.0:1783969281.324832:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1783969281.324910:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1783969281.324942:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1783969281.325009:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1783969281.325043:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1783969281.325088:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1783969281.325121:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1783969281.325152:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1783969281.325559:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1783969281.325594:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1783969281.325629:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1783969281.325677:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1783969281.325714:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1783969281.325746:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1783969281.325810:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1783969281.325913:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1783969281.326070:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1783969281.326143:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1783969281.326356:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1783969281.326469:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1783969281.326525:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1783969281.326565:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1783969281.326601:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1783969281.326654:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1783969281.326694:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1783969281.326725:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1783969281.326778:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1783969281.326820:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1783969281.329495:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba613b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280526720:0@lo:502: 00000100:00100000:2.0:1783969281.329592:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969281.329643:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac791933c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783969281.329762:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280526720 00000100:00100000:3.0:1783969281.329770:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280526720 00000100:00100000:3.0:1783969281.329831:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783969281.329841:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+12:6590:x1870627280526720:12345-0@lo:502: 00000100:00100000:3.0:1783969281.330602:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+12:6590:x1870627280526720:12345-0@lo:502: Request processed in 759us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969281.330610:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783969281.330717:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba613b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280526720:0@lo:502: 00000040:00080000:2.0:1783969281.331101:0:6590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1783969281.331121:0:6590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1783969281.331825:0:6615:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1783969281.331839:0:6615:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ac7b6433380) 00000020:00000080:1.0:1783969281.332104:0:6615:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1783969281.332691:0:6615:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac7ba5f7000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783969281.332696:0:6615:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ac7ba5f7000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783969281.332699:0:6615:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac7ba5f7000 3 00010000:00080000:1.0:1783969281.332731:0:6615:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ac7bfa6a800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.139@tcp at head 00010000:00010000:1.0:1783969281.336611:0:6615:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1783969281.336742:0:6615:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1783969281.336792:0:6615:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783969281.336805:0:6615:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xbacf56d076faab81 00000100:00080000:1.0:1783969281.336815:0:6615:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783969281.336823:0:6615:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ac7bfa6a800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1783969281.337965:0:6615:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac798165f80 x1870627280526848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783969281.338079:0:6615:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783969281.338176:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3284:1870627280526848:0@lo:38: 00000100:00100000:0.0:1783969281.338250:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1783969281.338673:0:6615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1783969281.339058:0:6590:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1783969281.339086:0:6590:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783969281.339106:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faab6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faab73 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969281.339119:0:6590:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faab6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faab73 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783969281.339220:0:6590:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783969281.339223:0:6590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783969281.339224:0:6590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969281.339226:0:6590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969281.339227:0:6590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969281.339228:0:6590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969281.339230:0:6590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783969281.339231:0:6590:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783969281.339239:0:6590:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783969281.339240:0:6590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969281.339241:0:6590:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783969281.339245:0:6590:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1783969281.339247:0:6590:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783969281.339248:0:6590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783969281.339249:0:6590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969281.339250:0:6590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969281.339251:0:6590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969281.339251:0:6590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969281.339252:0:6590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783969281.339253:0:6590:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783969281.339254:0:6590:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783969281.339254:0:6590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969281.339255:0:6590:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783969281.339348:0:6590:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783969281.339362:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba613b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280526976:0@lo:253: 00000100:00100000:2.0:1783969281.339423:0:6590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969281.339567:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac791933180 going to sleep for 11 seconds 00000100:00100000:2.0:1783969281.343341:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870627280527104:0@lo:400: 00000100:00100000:3.0:1783969281.343666:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280526848 00000100:00100000:3.0:1783969281.343676:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280526848 00000100:00100000:3.0:1783969281.343713:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783969281.343720:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3284:x1870627280526848:12345-0@lo:38: 00010000:00080000:3.0:1783969281.343755:0:5795:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 138 last 0 00000020:00000080:3.0:1783969281.343791:0:5795:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xbacf56d076faab88 00000004:00100000:3.0:1783969281.343807:0:5795:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783969281.343836:0:5795:0:(import.c:65:import_set_state_nolock()) ffff9ac7bf767800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783969281.350006:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280526976 00000100:00100000:1.0:1783969281.350019:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280526976 00000100:00100000:1.0:1783969281.350076:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783969281.350086:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+12:6590:x1870627280526976:12345-0@lo:253: 20000000:01000000:1.0:1783969281.350117:0:5788:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783969281.350131:0:5788:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1783969281.350984:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969281.351398:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1783969281.351410:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1783969281.351488:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1870627280526848:12345-0@lo:38: Request processed in 7764us (13234us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969281.351500:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783969281.351523:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280527104 00000100:00100000:3.0:1783969281.351531:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280527104 00000100:00100000:3.0:1783969281.351559:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783969281.351566:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870627280527104:12345-0@lo:400: 00000100:00100000:3.0:1783969281.351617:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870627280527104:12345-0@lo:400: Request processed in 52us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969281.351623:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783969281.351662:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ac785314380 x1870627280527104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969281.351676:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870627280527104:0@lo:400: 00010000:00080000:0.0:1783969281.352123:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ac798165f80 x1870627280526848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783969291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969281.352131:0:3284:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783969281.352138:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1783969281.352145:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783969281.352150:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783969281.352153:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9ac7bfa6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783969281.352711:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3284:1870627280526848:0@lo:38: 20000000:01000000:1.0:1783969281.398983:0:5788:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783969281.399036:0:5788:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1783969281.399336:0:5809:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783969281.399341:0:5809:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783969281.399362:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac783de6a00/0xbacf56d076faab8f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.399379:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac7c21e3400/0xbacf56d076faaafc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faaaf5 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.399387:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ac783de6a00/0xbacf56d076faab8f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.399444:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac7c21e3400/0xbacf56d076faaafc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faaaf5 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969281.399459:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac7c21e3400/0xbacf56d076faaafc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faaaf5 expref: 12 pid: 5787 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969281.399472:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5809:1870627280527232:0@lo:104: 00000100:00100000:3.0:1783969281.399534:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969281.399635:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b00ca240 going to sleep for 11 seconds 00000100:00100000:1.0:1783969281.399700:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280527232 00000100:00100000:1.0:1783969281.399707:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280527232 00000100:00100000:1.0:1783969281.400635:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783969281.400648:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785314700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+3:5809:x1870627280527232:12345-0@lo:104: 00010000:00010000:1.0:1783969281.400664:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac780030c00/0xbacf56d076faaaf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faaafc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.400737:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783969281.400743:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785314700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+3:5809:x1870627280527232:12345-0@lo:104: Request processed in 100us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969281.400752:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1783969281.400784:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969281.400790:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac780030c00/0xbacf56d076faaaf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faaafc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.400798:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac780030c00 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:1.0:1783969281.400802:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac780030c00/0xbacf56d076faaaf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faaafc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.400811:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac780030c00/0xbacf56d076faaaf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faaafc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783969281.400818:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac780030c00/0xbacf56d076faaaf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faaafc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969281.400825:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783969281.400887:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac780030c00/0xbacf56d076faaaf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faaafc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.400893:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783969281.400912:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac780030c00/0xbacf56d076faaaf5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faaafc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.400919:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac780030c00/0xbacf56d076faaaf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faaafc expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.400937:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969281.400939:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969281.400941:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969281.400972:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280527360:0@lo:103: 00000100:00100000:1.0:1783969281.401009:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969281.401056:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280527360 00000100:00100000:1.0:1783969281.401068:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280527360 00010000:00010000:1.0:1783969281.401087:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac7c21e3400/0xbacf56d076faaafc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faaaf5 expref: 13 pid: 5787 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969281.401109:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783969281.401116:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a61450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c893ad09-f78f-4711-bea5-6489668294ed+13:3285:x1870627280527360:12345-0@lo:103: 00010000:00010000:1.0:1783969281.401126:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969281.401131:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac7c21e3400/0xbacf56d076faaafc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faaaf5 expref: 13 pid: 5787 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.401142:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac7c21e3400/0xbacf56d076faaafc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faaaf5 expref: 13 pid: 5787 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.401169:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ac783de6a00/0xbacf56d076faab8f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.401177:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac783de6a00/0xbacf56d076faab8f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783969281.401193:0:5779:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001851733s 00010000:00010000:1.0:1783969281.401197:0:5779:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac783de6a00/0xbacf56d076faab8f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.401204:0:5779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac783de6a00/0xbacf56d076faab8f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.401210:0:5779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac783de6a00/0xbacf56d076faab8f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.401216:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac783de6a00/0xbacf56d076faab8f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.401231:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6a00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969281.401235:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac783de6a00/0xbacf56d076faab8f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.401243:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac783de6a00/0xbacf56d076faab8f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.401251:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac783de6a00/0xbacf56d076faab8f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.401455:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969281.401490:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a61450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c893ad09-f78f-4711-bea5-6489668294ed+13:3285:x1870627280527360:12345-0@lo:103: Request processed in 374us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969281.401496:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783969281.401582:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798167800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280527360:0@lo:103: 00010000:00010000:1.0:1783969281.401614:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7c21e3400/0xbacf56d076faaafc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faaaf5 expref: 12 pid: 5787 timeout: 288 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969281.401625:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5809:1870627280527232:0@lo:104: 00010000:00010000:1.0:1783969281.401637:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ac783de6a00/0xbacf56d076faab8f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.401645:0:5809:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ac783de6a00/0xbacf56d076faab8f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.401651:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac783de6a00/0xbacf56d076faab8f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969281.401657:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac783de6a00/0xbacf56d076faab8f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969281.424699:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+11:6590:x1870627280526976:12345-0@lo:253: Request processed in 74605us (85266us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969281.424715:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783969281.424979:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba613b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:6590:1870627280526976:0@lo:253: 10000000:01000000:2.0:1783969281.424993:0:6590:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783969281.424996:0:6590:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783969281.424997:0:6590:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783969281.424998:0:6590:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969281.424999:0:6590:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969281.425001:0:6590:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969281.425002:0:6590:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969281.425003:0:6590:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783969281.425005:0:6590:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783969281.425006:0:6590:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783969281.425007:0:6590:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969281.425009:0:6590:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783969281.425031:0:6590:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1783969281.438737:0:6590:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1783969281.438987:0:6590:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1783969281.439363:0:6590:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1783969281.439544:0:6590:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1783969281.439720:0:6590:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1783969281.446150:0:6590:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1783969281.448682:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1783969281.574925:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1783969281.698932:0:6590:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1783969281.698947:0:6590:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1783969281.698992:0:6590:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783969281.699050:0:6590:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.139@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783969281.699064:0:6590:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1783969281.699090:0:6590:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 10000000:01000000:2.0:1783969282.085490:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783969282.085497:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ac783021000 from 21 10000000:01000000:2.0:1783969282.085503:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783969282.085544:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3400/0xbacf56d076faab96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969282.085556:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3400/0xbacf56d076faab96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969282.085567:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3400/0xbacf56d076faab96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969282.085589:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba613b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280527488:0@lo:101: 00000100:00100000:2.0:1783969282.085657:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969282.085726:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa2d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969282.085831:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280527488 00000100:00100000:0.0:1783969282.085838:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280527488 00000100:00100000:0.0:1783969282.085909:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783969282.085919:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+11:5790:x1870627280527488:12345-0@lo:101: 00010000:00010000:0.0:1783969282.085934:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969282.085959:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac780030600/0xbacf56d076faab9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faab96 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969282.085983:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac780030600/0xbacf56d076faab9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faab96 expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969282.085993:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac780030600/0xbacf56d076faab9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faab96 expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969282.086001:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac780030600, rc 0) 00000100:00100000:0.0:1783969282.086042:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+12:5790:x1870627280527488:12345-0@lo:101: Request processed in 126us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969282.086060:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783969282.086275:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba613b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280527488:0@lo:101: 00010000:00010000:2.0:1783969282.086289:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3400/0xbacf56d076faab96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faab9d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969282.086298:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3400/0xbacf56d076faab96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faab9d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969282.086368:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba613b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280527616:0@lo:501: 00000100:00100000:2.0:1783969282.086396:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969282.086416:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa2d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969282.086469:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280527616 00000100:00100000:3.0:1783969282.086474:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280527616 00000100:00100000:3.0:1783969282.086507:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783969282.086515:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+12:5790:x1870627280527616:12345-0@lo:501: 00000100:00100000:3.0:1783969282.086780:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+12:5790:x1870627280527616:12345-0@lo:501: Request processed in 264us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969282.086787:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783969282.087141:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba613b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280527616:0@lo:501: 00000100:00100000:2.0:1783969282.087188:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba613b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280527744:0@lo:503: 00000100:00100000:2.0:1783969282.087232:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969282.087260:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa2d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969282.087338:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280527744 00000100:00100000:0.0:1783969282.087343:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280527744 00000100:00100000:0.0:1783969282.087376:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783969282.087382:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+12:5790:x1870627280527744:12345-0@lo:503: 00000100:00100000:0.0:1783969282.087525:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+12:5790:x1870627280527744:12345-0@lo:503: Request processed in 143us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969282.087532:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783969282.087672:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba613b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280527744:0@lo:503: 00000100:00100000:2.0:1783969282.089137:0:6636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba613b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:6636:1870627280527872:0@lo:502: 00000100:00100000:2.0:1783969282.089204:0:6636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969282.089245:0:6636:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa2de40 going to sleep for 11 seconds 00000100:00100000:3.0:1783969282.089373:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280527872 00000100:00100000:3.0:1783969282.089379:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280527872 00000100:00100000:3.0:1783969282.089419:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783969282.089427:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+12:6636:x1870627280527872:12345-0@lo:502: 00000100:00100000:3.0:1783969282.089650:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+12:6636:x1870627280527872:12345-0@lo:502: Request processed in 224us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969282.089658:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783969282.089901:0:6636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba613b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:6636:1870627280527872:0@lo:502: 00000100:00100000:2.0:1783969282.089973:0:6636:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba613b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:6636:1870627280528000:0@lo:502: 00000100:00100000:2.0:1783969282.090012:0:6636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969282.090030:0:6636:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa2de40 going to sleep for 11 seconds 00000100:00100000:1.0:1783969282.090108:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280528000 00000100:00100000:1.0:1783969282.090114:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280528000 00000100:00100000:1.0:1783969282.090142:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783969282.090149:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+12:6636:x1870627280528000:12345-0@lo:502: 00000100:00100000:1.0:1783969282.090310:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+12:6636:x1870627280528000:12345-0@lo:502: Request processed in 160us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969282.090318:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783969282.090508:0:6636:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba613b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:6636:1870627280528000:0@lo:502: 00000040:00080000:2.0:1783969282.090534:0:6636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1783969282.090965:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1783969282.090983:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783969282.090992:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3400/0xbacf56d076faab96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faab9d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.091004:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3400/0xbacf56d076faab96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faab9d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969282.091013:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783969282.091015:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ac783021000 from 4 10000000:01000000:1.0:1783969282.091018:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783969282.091047:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faaba4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.091056:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faaba4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.091063:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faaba4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969282.091087:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798167800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280528128:0@lo:101: 00000100:00100000:1.0:1783969282.091132:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969282.091165:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac787633cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969282.091205:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280528128 00000100:00100000:2.0:1783969282.091210:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280528128 00000100:00100000:2.0:1783969282.091237:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783969282.091244:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+12:5790:x1870627280528128:12345-0@lo:101: 00010000:00010000:2.0:1783969282.091266:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969282.091279:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faabab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faaba4 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969282.091301:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faabab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faaba4 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969282.091311:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faabab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faaba4 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969282.091332:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c21e2c00, rc 0) 00000100:00100000:2.0:1783969282.091380:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+13:5790:x1870627280528128:12345-0@lo:101: Request processed in 137us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969282.091387:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783969282.091597:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798167800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280528128:0@lo:101: 00010000:00010000:1.0:1783969282.091610:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faaba4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faabab expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.091620:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faaba4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faabab expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969282.091668:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798167800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280528256:0@lo:256: 00000100:00100000:1.0:1783969282.091699:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969282.091725:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac787633cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969282.091843:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280528256 00000100:00100000:3.0:1783969282.091848:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280528256 00000100:00100000:3.0:1783969282.091905:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783969282.091912:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+13:5790:x1870627280528256:12345-0@lo:256: 20000000:01000000:3.0:1783969282.091926:0:5786:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783969282.091943:0:5786:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783969282.091956:0:5786:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1783969282.092039:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+13:5790:x1870627280528256:12345-0@lo:256: Request processed in 128us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969282.092047:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783969282.092078:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798167800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280528256:0@lo:256: 10000000:01000000:3.0:1783969282.092114:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783969282.092129:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faaba4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faabab expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.092136:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faaba4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faabab expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969282.092143:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1783969282.092145:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1783969282.092147:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783969282.092164:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faabb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.092170:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faabb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.092182:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faabb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969282.092193:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785316a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280528384:0@lo:101: 00000100:00100000:3.0:1783969282.092217:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969282.092229:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7860b06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969282.092240:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280528384 00000100:00100000:3.0:1783969282.092243:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280528384 00000100:00100000:3.0:1783969282.092426:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783969282.092433:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+13:5790:x1870627280528384:12345-0@lo:101: 00010000:00010000:3.0:1783969282.092441:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969282.092451:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac783de7400/0xbacf56d076faabb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faabb2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.092465:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac783de7400/0xbacf56d076faabb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faabb2 expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.092473:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac783de7400/0xbacf56d076faabb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faabb2 expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.092480:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7400, rc 0) 00000100:00100000:3.0:1783969282.092512:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+14:5790:x1870627280528384:12345-0@lo:101: Request processed in 80us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969282.092518:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783969282.092545:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785316a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280528384:0@lo:101: 00010000:00010000:3.0:1783969282.092556:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faabb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faabb9 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969282.092572:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faabb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faabb9 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969282.092617:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785316a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280528512:0@lo:501: 00000100:00100000:3.0:1783969282.092639:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969282.092652:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7860b06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969282.092664:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280528512 00000100:00100000:3.0:1783969282.092668:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280528512 00000100:00100000:3.0:1783969282.092684:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783969282.092688:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+14:5790:x1870627280528512:12345-0@lo:501: 00000100:00100000:3.0:1783969282.093266:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+14:5790:x1870627280528512:12345-0@lo:501: Request processed in 564us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969282.093274:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783969282.096089:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785316a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280528512:0@lo:501: 00000100:00100000:3.0:1783969282.098123:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785316a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280528640:0@lo:503: 00000100:00100000:3.0:1783969282.098202:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969282.098261:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7860b00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969282.098314:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280528640 00000100:00100000:0.0:1783969282.098321:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280528640 00000100:00100000:0.0:1783969282.098383:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783969282.098392:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+14:5790:x1870627280528640:12345-0@lo:503: 00000100:00100000:0.0:1783969282.098667:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+14:5790:x1870627280528640:12345-0@lo:503: Request processed in 276us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969282.098675:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783969282.099078:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785316a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280528640:0@lo:503: 00000100:00100000:2.0:1783969282.099832:0:6637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba613b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:6637:1870627280528768:0@lo:502: 00000100:00100000:3.0:1783969282.100038:0:6637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969282.100073:0:6637:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa2dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1783969282.100183:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280528768 00000100:00100000:2.0:1783969282.100189:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280528768 00000100:00100000:2.0:1783969282.101500:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783969282.101517:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+14:6637:x1870627280528768:12345-0@lo:502: 00000100:00100000:2.0:1783969282.102224:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+14:6637:x1870627280528768:12345-0@lo:502: Request processed in 711us (2183us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969282.102233:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783969282.102375:0:6637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba613b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:6637:1870627280528768:0@lo:502: 00000020:01000000:3.0:1783969282.102419:0:6637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783969282.102427:0:6637:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1783969282.102433:0:6637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969282.102435:0:6637:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783969282.102440:0:6637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783969282.102444:0:6637:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.139@tcp to nid 0x20000c0a8cb8b (192.168.203.139@tcp) 00000020:01000000:3.0:1783969282.102473:0:6637:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783969282.102476:0:6637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783969282.102489:0:6637:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ac7ba7319c0) 00000020:00000080:3.0:1783969282.102509:0:6637:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1783969282.102516:0:6637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783969282.102605:0:6637:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1783969282.102610:0:6637:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783969282.102617:0:6637:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbacf56d076faabc7 00010000:00080000:3.0:1783969282.102653:0:6637:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ac7c19c0000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.139@tcp at head 00010000:00010000:3.0:1783969282.102902:0:6637:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1783969282.203196:0:6637:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1783969282.203222:0:6637:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783969282.203706:0:6637:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783969282.203892:0:6637:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783969282.203956:0:6637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1783969282.204022:0:6637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1783969282.205187:0:6642:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783969282.205193:0:6642:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783969282.207095:0:6637:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783969282.207109:0:6637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783969282.207156:0:6637:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783969282.207179:0:6637:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbacf56d076faabce 00000100:00080000:2.0:1783969282.207190:0:6637:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783969282.207196:0:6637:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ac7c19c0000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1783969282.207232:0:6637:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac7ba613100 x1870627280528896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783969282.207369:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1870627280528896:0@lo:8: 00000100:00100000:0.0:1783969282.207437:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783969282.207507:0:6637:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1783969282.207565:0:6637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783969282.207576:0:6637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969282.207578:0:6637:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783969282.207582:0:6637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783969282.207586:0:6637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969282.207587:0:6637:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783969282.207590:0:6637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783969282.207592:0:6637:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783969282.207617:0:6637:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba610000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:6637:1870627280529024:0@lo:502: 00000100:00100000:2.0:1783969282.207662:0:6637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969282.207679:0:6637:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa2d840 going to sleep for 11 seconds 00000100:00100000:2.0:1783969282.207755:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280529024 00000100:00100000:2.0:1783969282.207761:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280529024 00000100:00100000:2.0:1783969282.207793:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783969282.207801:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+14:6637:x1870627280529024:12345-0@lo:502: 00000100:00100000:2.0:1783969282.208055:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+14:6637:x1870627280529024:12345-0@lo:502: Request processed in 253us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969282.208063:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783969282.208102:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280529280:0@lo:400: 00000100:00100000:2.0:1783969282.208131:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969282.208174:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280529280 00000100:00100000:2.0:1783969282.208178:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280529280 00000100:00100000:2.0:1783969282.208212:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783969282.208219:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280529280:12345-0@lo:400: 00000100:00100000:2.0:1783969282.208510:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280529280:12345-0@lo:400: Request processed in 288us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969282.208517:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1783969282.208552:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac7ba611180 x1870627280529280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969282.208564:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280529280:0@lo:400: 00000100:00100000:2.0:1783969282.208625:0:6637:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba610000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:6637:1870627280529024:0@lo:502: 00000020:01000000:2.0:1783969282.208656:0:6637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783969282.208661:0:6637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969282.208663:0:6637:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783969282.208666:0:6637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1783969282.208766:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1783969282.208782:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00100000:1.0:1783969282.208788:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1870627280529152:0@lo:400: 00010000:00010000:2.0:1783969282.208790:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faabb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faabb9 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969282.208799:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faabb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faabb9 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969282.208808:0:5790:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783969282.208811:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ac783021000 from 1 10000000:01000000:2.0:1783969282.208813:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000100:00100000:1.0:1783969282.208824:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783969282.208836:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faabd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969282.208844:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faabd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969282.208853:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faabd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783969282.208876:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969282.208889:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280529152 00000100:00100000:1.0:1783969282.208893:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280529152 00000100:00100000:1.0:1783969282.208918:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783969282.208925:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1870627280529152:12345-0@lo:400: 00000100:00100000:1.0:1783969282.208976:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798165180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1870627280529152:12345-0@lo:400: Request processed in 51us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969282.208983:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1783969282.209013:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac7ba612d80 x1870627280529152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969282.209023:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1870627280529152:0@lo:400: 00000100:00100000:3.0:1783969282.209572:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280528896 00000100:00100000:3.0:1783969282.209579:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280528896 00000100:00100000:3.0:1783969282.209605:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783969282.209610:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3284:x1870627280528896:12345-0@lo:8: 00010000:00080000:3.0:1783969282.209632:0:6593:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 139 last 0 00000020:00000080:3.0:1783969282.209654:0:6593:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbacf56d076faabdc 00002000:00100000:3.0:1783969282.209710:0:6593:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ac7c19c4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1783969282.209714:0:6593:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1783969282.209718:0:6593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1783969282.209824:0:6593:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783969282.209980:0:6593:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783969282.210004:0:6593:0:(import.c:65:import_set_state_nolock()) ffff9ac7c19c5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783969282.210096:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba610000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280529408:0@lo:101: 00000100:00100000:2.0:1783969282.210145:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969282.210166:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa2d840 going to sleep for 11 seconds 00000100:00100000:2.0:1783969282.210190:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280529408 00000100:00100000:2.0:1783969282.210193:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280529408 00000100:00100000:2.0:1783969282.210225:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783969282.210232:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+14:5790:x1870627280529408:12345-0@lo:101: 00010000:00010000:2.0:1783969282.210241:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969282.210265:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7c21e3e00/0xbacf56d076faabe3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faabd5 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969282.210288:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7c21e3e00/0xbacf56d076faabe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faabd5 expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969282.210298:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7c21e3e00/0xbacf56d076faabe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faabd5 expref: 15 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969282.210306:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c21e3e00, rc 0) 00000100:00100000:2.0:1783969282.210332:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+15:5790:x1870627280529408:12345-0@lo:101: Request processed in 101us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969282.210336:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783969282.210371:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba610000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280529408:0@lo:101: 00010000:00010000:2.0:1783969282.210383:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faabd5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faabe3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969282.210391:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faabd5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faabe3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969282.210441:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba610000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280529536:0@lo:501: 00000100:00100000:2.0:1783969282.210464:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969282.210481:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa2d840 going to sleep for 11 seconds 00000100:00100000:1.0:1783969282.210872:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280529536 00000100:00100000:1.0:1783969282.210877:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280529536 00000100:00100000:1.0:1783969282.210904:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783969282.210911:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+15:5790:x1870627280529536:12345-0@lo:501: 00000100:00100000:3.0:1783969282.211000:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3284:x1870627280528896:12345-0@lo:8: Request processed in 1388us (3562us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969282.211012:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783969282.211078:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac7ba613100 x1870627280528896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783969292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969282.211088:0:3284:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783969282.211095:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1783969282.211102:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783969282.211107:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783969282.211109:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9ac7c19c0000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783969282.211152:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+15:5790:x1870627280529536:12345-0@lo:501: Request processed in 241us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969282.211159:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783969282.211233:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba610000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280529536:0@lo:501: 00000100:00100000:3.0:1783969282.211281:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785316a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280529664:0@lo:503: 00000100:00100000:3.0:1783969282.211317:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969282.211338:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7860b06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969282.211569:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280529664 00000100:00100000:2.0:1783969282.211574:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280529664 00000100:00100000:2.0:1783969282.211607:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783969282.211619:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+15:5790:x1870627280529664:12345-0@lo:503: 00000100:00100000:2.0:1783969282.211790:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+15:5790:x1870627280529664:12345-0@lo:503: Request processed in 172us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969282.211797:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783969282.211833:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785316a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280529664:0@lo:503: 00000004:00080000:0.0:1783969282.212352:0:3284:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783969282.212362:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba613100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1870627280528896:0@lo:8: 00000004:00080000:3.0:1783969282.212479:0:6642:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783969282.212584:0:6642:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 139294723492ns, next at 0ns, rc = 0 00000100:00100000:2.0:1783969282.216543:0:6645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba611180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:6645:1870627280529792:0@lo:502: 00000100:00100000:2.0:1783969282.216618:0:6645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969282.216653:0:6645:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa2dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969282.216837:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280529792 00000100:00100000:1.0:1783969282.216845:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280529792 00000100:00100000:1.0:1783969282.216903:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783969282.216911:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+15:6645:x1870627280529792:12345-0@lo:502: 00000100:00100000:1.0:1783969282.217102:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+15:6645:x1870627280529792:12345-0@lo:502: Request processed in 190us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969282.217109:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783969282.217165:0:6645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba611180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:6645:1870627280529792:0@lo:502: 00000020:01000000:1.0:1783969282.217203:0:6645:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969282.217212:0:6645:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969282.217214:0:6645:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783969282.217220:0:6645:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac783021000 00000020:00000080:1.0:1783969282.217222:0:6645:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783969282.217242:0:6645:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798165880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:6645:1870627280529920:0@lo:502: 00000100:00100000:1.0:1783969282.217273:0:6645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969282.217293:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280529920 00000100:00100000:1.0:1783969282.217296:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280529920 00000100:00100000:1.0:1783969282.217314:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783969282.217319:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+15:6645:x1870627280529920:12345-0@lo:502: 00000100:00100000:1.0:1783969282.217474:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+15:6645:x1870627280529920:12345-0@lo:502: Request processed in 154us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969282.217486:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783969282.217510:0:6645:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac79120f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969282.217520:0:6645:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798165880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:6645:1870627280529920:0@lo:502: 00000020:01000000:1.0:1783969282.217534:0:6645:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969282.217538:0:6645:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969282.217539:0:6645:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1783969282.217542:0:6645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1783969282.217586:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1783969282.217611:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783969282.217619:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faabd5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faabe3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.217629:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faabd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faabe3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969282.217637:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1783969282.217639:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9ac7917f19c0 from 1 10000000:01000000:1.0:1783969282.217642:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783969282.217661:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faabea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.217669:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faabea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.217678:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faabea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969282.217688:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798165880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280530048:0@lo:101: 00000100:00100000:1.0:1783969282.217710:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969282.217728:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac79120f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969282.217738:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280530048 00000100:00100000:1.0:1783969282.217741:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280530048 00000100:00100000:1.0:1783969282.217758:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783969282.217763:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+15:5790:x1870627280530048:12345-0@lo:101: 00010000:00010000:1.0:1783969282.217771:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969282.217781:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac781497200/0xbacf56d076faabf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faabea expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.217801:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac781497200/0xbacf56d076faabf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faabea expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.217810:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac781497200/0xbacf56d076faabf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faabea expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.217818:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac781497200, rc 0) 00000100:00100000:1.0:1783969282.217841:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+16:5790:x1870627280530048:12345-0@lo:101: Request processed in 78us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969282.217847:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783969282.217890:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798165880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280530048:0@lo:101: 00010000:00010000:1.0:1783969282.217901:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faabea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faabf1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.217910:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faabea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faabf1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969282.217958:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798165880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280530176:0@lo:501: 00000100:00100000:1.0:1783969282.217979:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969282.217989:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac79120f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969282.218003:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280530176 00000100:00100000:1.0:1783969282.218006:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280530176 00000100:00100000:1.0:1783969282.218022:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783969282.218027:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+16:5790:x1870627280530176:12345-0@lo:501: 00000100:00100000:1.0:1783969282.218185:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+16:5790:x1870627280530176:12345-0@lo:501: Request processed in 156us (204us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783969282.218191:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783969282.218219:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798165880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280530176:0@lo:501: 10000000:01000000:1.0:1783969282.218235:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783969282.218240:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faabea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faabf1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969282.218246:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faabea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faabf1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783969282.302163:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1783969282.351243:0:6644:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1783969282.351338:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280530304:0@lo:13: 00000100:00100000:1.0:1783969282.351411:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969282.351498:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280530304 00000100:00100000:1.0:1783969282.351506:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280530304 00000100:00100000:1.0:1783969282.351554:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783969282.351562:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1870627280530304:12345-0@lo:13: 00002000:00000024:1.0:1783969282.351584:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:1.0:1783969282.351628:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798165880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1870627280530304:12345-0@lo:13: Request processed in 66us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969282.351635:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1783969282.351653:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783969282.351681:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac7ba613800 x1870627280530304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969282.351716:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba613800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280530304:0@lo:13: 00000100:00100000:2.0:1783969282.352065:0:6644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba611500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6644:1870627280530432:0@lo:7: 00000100:00100000:2.0:1783969282.352112:0:6644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969282.352133:0:6644:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa2dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969282.352199:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280530432 00000100:00100000:1.0:1783969282.352204:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280530432 00000100:00100000:1.0:1783969282.352231:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783969282.352238:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6644:x1870627280530432:12345-0@lo:7: 00002000:00080000:0.0:1783969282.376340:0:6595:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1783969282.376351:0:6595:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1783969282.378146:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6644:x1870627280530432:12345-0@lo:7: Request processed in 25900us (26026us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969282.378164:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783969282.382028:0:6644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac7ba611500 x1870627280530432/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783969298 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969282.382126:0:6644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba611500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6644:1870627280530432:0@lo:7: 00000004:00080000:1.0:1783969282.382142:0:6644:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1783969282.382196:0:6644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798165c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6644:1870627280530560:0@lo:5: 00000100:00100000:1.0:1783969282.382253:0:6644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969282.382363:0:6644:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac79120f540 going to sleep for 11 seconds 00000100:00100000:3.0:1783969282.391252:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280530560 00000100:00100000:3.0:1783969282.391268:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280530560 00000100:00100000:2.0:1783969282.391382:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783969282.391392:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6644:x1870627280530560:12345-0@lo:5: 00002000:00080000:2.0:1783969282.391422:0:6593:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1783969282.391426:0:6593:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1783969282.391797:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798166680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6644:x1870627280530560:12345-0@lo:5: Request processed in 405us (9542us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783969282.391804:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783969282.392450:0:6644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac798165c00 x1870627280530560/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783969298 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969282.392468:0:6644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798165c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6644:1870627280530560:0@lo:5: 00000004:00080000:3.0:1783969282.392481:0:6644:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1783969282.392518:0:6644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785317b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6644:1870627280530688:0@lo:700: 00000100:00100000:3.0:1783969282.392555:0:6644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969282.392598:0:6644:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac78897d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969282.392651:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280530688 00000100:00100000:2.0:1783969282.392657:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280530688 00000100:00100000:2.0:1783969282.392698:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783969282.392705:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6644:x1870627280530688:12345-0@lo:700: 00000100:00100000:2.0:1783969282.392737:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba611180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6601:1870627280530816:0@lo:700: 00000100:00100000:2.0:1783969282.392778:0:6601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969282.392811:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa2d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969282.393998:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280530816 00000100:00100000:2.0:1783969282.394008:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280530816 00000100:00100000:2.0:1783969282.394069:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783969282.394078:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6601:x1870627280530816:12345-0@lo:700: 40000000:02000000:3.0:1783969282.520247:0:5800:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1783969282.529112:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6601:x1870627280530816:12345-0@lo:700: Request processed in 135028us (136325us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969282.529151:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783969282.529697:0:6601:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac7ba611180 x1870627280530816/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783969298 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969282.529712:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba611180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6601:1870627280530816:0@lo:700: 40000000:02000000:2.0:1783969282.529724:0:6601:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:1.0:1783969282.624304:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783969282.670307:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1783969282.670323:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1783969282.670525:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785317480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6644:x1870627280530688:12345-0@lo:700: Request processed in 277816us (277964us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969282.670537:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783969282.670575:0:6644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac785317b80 x1870627280530688/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783969298 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969282.670587:0:6644:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1783969282.670603:0:6644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785317b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6644:1870627280530688:0@lo:700: 00000004:02000040:0.0:1783969282.715179:0:6644:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1783969282.723004:0:6644:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba611180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6644:1870627280530944:0@lo:5: 00000100:00100000:2.0:1783969282.723073:0:6644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969282.723129:0:6644:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7838b1780 going to sleep for 11 seconds 00000100:00100000:1.0:1783969282.726166:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280530944 00000100:00100000:1.0:1783969282.726180:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280530944 00000100:00100000:1.0:1783969282.726243:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783969282.726255:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6644:x1870627280530944:12345-0@lo:5: 00002000:00080000:1.0:1783969282.742080:0:6595:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1783969282.742101:0:6595:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1783969282.753724:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba610000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6644:x1870627280530944:12345-0@lo:5: Request processed in 27464us (30642us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1783969282.753736:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1783969282.754360:0:6644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac7ba611180 x1870627280530944/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783969298 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969282.754378:0:6644:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba611180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6644:1870627280530944:0@lo:5: 00000004:00080000:2.0:1783969282.754454:0:6644:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1783969283.621450:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969284.645042:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969285.669296:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969286.697417:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969287.278719:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798166300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1870627280531200:0@lo:400: 00000100:00100000:1.0:1783969287.278790:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969287.278907:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783969287.278924:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280531072:0@lo:400: 00000100:00100000:1.0:1783969287.278977:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969287.279005:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798164700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280531328:0@lo:400: 00000100:00100000:1.0:1783969287.279031:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969287.287123:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969287.287143:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280531456:0@lo:400: 00000100:00100000:1.0:1783969287.287204:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969287.287245:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280531072 00000100:00100000:1.0:1783969287.287252:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280531072 00000100:00100000:1.0:1783969287.287297:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783969287.287306:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+16:3286:x1870627280531072:12345-0@lo:400: 00000100:00100000:1.0:1783969287.287357:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+16:3286:x1870627280531072:12345-0@lo:400: Request processed in 52us (8379us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969287.287365:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783969287.293694:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280531200 00000100:00100000:2.0:1783969287.293709:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280531200 00000100:00100000:2.0:1783969287.293776:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280531328 00000100:00100000:2.0:1783969287.293779:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280531328 00000100:00100000:2.0:1783969287.293813:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783969287.293822:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1870627280531200:12345-0@lo:400: 00000100:00100000:2.0:1783969287.293931:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798167b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1870627280531200:12345-0@lo:400: Request processed in 110us (15141us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969287.293944:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783969287.293960:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783969287.293965:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280531328:12345-0@lo:400: 00000100:00100000:2.0:1783969287.294001:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798167480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280531328:12345-0@lo:400: Request processed in 35us (14969us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969287.294007:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783969287.294029:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280531456 00000100:00100000:2.0:1783969287.294032:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280531456 00000100:00100000:2.0:1783969287.294055:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783969287.294060:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3287:x1870627280531456:12345-0@lo:400: 00000100:00100000:2.0:1783969287.294088:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3287:x1870627280531456:12345-0@lo:400: Request processed in 28us (6885us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969287.294094:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1783969287.294107:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783969287.294111:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783969287.294146:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac798166a00 x1870627280531456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969287.294162:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798166a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280531456:0@lo:400: 00010000:00080000:2.0:1783969287.294173:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac798164700 x1870627280531328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969287.294183:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798164700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280531328:0@lo:400: 00000100:00100000:1.0:1783969287.295003:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798164380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280531072:0@lo:400: 00010000:00080000:1.0:1783969287.295017:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac798166300 x1870627280531200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969287.295028:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798166300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1870627280531200:0@lo:400: 00010000:00010000:0.0:1783969287.719255:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969287.783178:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280531584:0@lo:13: 00000100:00100000:3.0:1783969287.783250:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969287.783312:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280531584 00000100:00100000:3.0:1783969287.783318:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280531584 00000100:00100000:3.0:1783969287.783352:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783969287.783359:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1870627280531584:12345-0@lo:13: 00002000:00000024:3.0:1783969287.783389:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783969287.783424:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3285:x1870627280531584:12345-0@lo:13: Request processed in 66us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969287.783431:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783969287.783476:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac785317b80 x1870627280531584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969287.783491:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280531584:0@lo:13: 00000001:00080000:3.0:1783969287.914693:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:02000400:2.0:1783969288.266252:0:6967:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783969288.742475:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969289.765079:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969290.789579:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969291.813015:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969292.390197:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280531840:0@lo:400: 00000100:00100000:0.0:1783969292.390263:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969292.390313:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783969292.390321:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280531968:0@lo:400: 00000100:00100000:0.0:1783969292.390342:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969292.390376:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280531840 00000100:00100000:0.0:1783969292.390382:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280531840 00000100:00100000:0.0:1783969292.390419:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280531968 00000100:00100000:0.0:1783969292.390423:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280531968 00000100:00100000:0.0:1783969292.390451:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783969292.390558:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280531712:0@lo:400: 00000100:00100000:3.0:1783969292.390593:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969292.390616:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783969292.390622:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280532096:0@lo:400: 00000100:00100000:3.0:1783969292.390647:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969292.390711:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280531712 00000100:00100000:1.0:1783969292.390716:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280531712 00000100:00100000:1.0:1783969292.390758:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783969292.390767:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+16:3286:x1870627280531712:12345-0@lo:400: 00000100:00100000:1.0:1783969292.390820:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+16:3286:x1870627280531712:12345-0@lo:400: Request processed in 55us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969292.390838:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783969292.390897:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280532096 00000100:00100000:1.0:1783969292.390900:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280532096 00000100:00100000:1.0:1783969292.390927:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783969292.390934:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280532096:12345-0@lo:400: 00000100:00100000:1.0:1783969292.390966:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280532096:12345-0@lo:400: Request processed in 32us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969292.390972:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783969292.391007:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac7a7a82d80 x1870627280532096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969292.391018:0:3286:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1783969292.391043:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280532096:0@lo:400: 00000100:00100000:1.0:1783969292.391054:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280531712:0@lo:400: 00000100:00100000:0.0:1783969292.391228:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280531840:12345-0@lo:400: 00000100:00100000:0.0:1783969292.391276:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280531840:12345-0@lo:400: Request processed in 818us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969292.391284:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783969292.391298:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783969292.391312:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280531968:12345-0@lo:400: 00000100:00100000:0.0:1783969292.391343:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280531968:12345-0@lo:400: Request processed in 32us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969292.391349:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1783969292.391371:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783969292.391375:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783969292.391450:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac7a7a80000 x1870627280531968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969292.391473:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280531968:0@lo:400: 00010000:00080000:1.0:1783969292.391485:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac7a7a83800 x1870627280531840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969292.391494:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280531840:0@lo:400: 00010000:00010000:1.0:1783969292.841087:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969292.902459:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280532224:0@lo:13: 00000100:00100000:1.0:1783969292.902525:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969292.903342:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280532224 00000100:00100000:0.0:1783969292.903350:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280532224 00000100:00100000:0.0:1783969292.903392:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783969292.903401:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280532224:12345-0@lo:13: 00002000:00000024:0.0:1783969292.903432:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783969292.903482:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798166300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280532224:12345-0@lo:13: Request processed in 81us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969292.903489:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783969292.903529:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac785314000 x1870627280532224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969292.903546:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280532224:0@lo:13: 00010000:00010000:0.0:1783969293.861257:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969294.885196:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969295.909308:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969296.933962:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969297.516394:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280532352:0@lo:400: 00000100:00100000:3.0:1783969297.516464:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969297.516514:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969297.516520:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280532480:0@lo:400: 00000100:00100000:3.0:1783969297.516544:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969297.516572:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280532608:0@lo:400: 00000100:00100000:3.0:1783969297.516610:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969297.516629:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969297.516635:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280532736:0@lo:400: 00000100:00100000:3.0:1783969297.516659:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969297.516687:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280532352 00000100:00100000:3.0:1783969297.516693:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280532352 00000100:00100000:3.0:1783969297.516734:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783969297.516743:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+16:3287:x1870627280532352:12345-0@lo:400: 00000100:00100000:3.0:1783969297.516790:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+16:3287:x1870627280532352:12345-0@lo:400: Request processed in 48us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969297.516797:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783969297.516827:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280532480 00000100:00100000:3.0:1783969297.516830:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280532480 00000100:00100000:3.0:1783969297.516905:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280532608 00000100:00100000:3.0:1783969297.516908:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280532608 00000100:00100000:3.0:1783969297.516936:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783969297.516943:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280532480:12345-0@lo:400: 00000100:00100000:3.0:1783969297.516977:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280532480:12345-0@lo:400: Request processed in 34us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969297.516983:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783969297.516995:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783969297.517000:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280532608:12345-0@lo:400: 00000100:00100000:3.0:1783969297.517026:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280532608:12345-0@lo:400: Request processed in 26us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969297.517031:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783969297.517047:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280532736 00000100:00100000:3.0:1783969297.517049:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280532736 00000100:00100000:3.0:1783969297.517078:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783969297.517083:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280532736:12345-0@lo:400: 00000100:00100000:3.0:1783969297.517110:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280532736:12345-0@lo:400: Request processed in 27us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969297.517115:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783969297.517159:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac785315180 x1870627280532480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969297.517171:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280532480:0@lo:400: 00000100:00100000:3.0:1783969297.517181:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280532352:0@lo:400: 00000100:00080000:3.0:1783969297.517203:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783969297.517207:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783969297.517223:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac785317800 x1870627280532736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969297.517231:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280532736:0@lo:400: 00010000:00080000:3.0:1783969297.517239:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac785314a80 x1870627280532608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969297.517247:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280532608:0@lo:400: 00010000:00010000:0.0:1783969297.958881:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969298.021059:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783969298.021085:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280532864:0@lo:13: 00000100:00100000:0.0:1783969298.021158:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969298.021249:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280532864 00000100:00100000:3.0:1783969298.021258:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280532864 00000100:00100000:3.0:1783969298.021316:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783969298.021331:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280532864:12345-0@lo:13: 00002000:00000024:3.0:1783969298.021365:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783969298.021413:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280532864:12345-0@lo:13: Request processed in 89us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969298.021420:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783969298.021913:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac7a7a80380 x1870627280532864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969298.021931:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280532864:0@lo:13: 00010000:00010000:1.0:1783969298.981755:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783969299.094831:0:7477:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1783969299.094835:0:7477:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1783969299.095789:0:7477:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9ac7bf7a8800 00000020:01000004:2.0:1783969299.095809:0:7477:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1783969299.095821:0:7477:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1783969299.095834:0:7477:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ac7861999c0) 00000020:00000080:2.0:1783969299.095872:0:7477:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783969299.115093:0:7477:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1783969299.115827:0:7477:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1783969299.146062:0:7477:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1783969299.150598:0:7477:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1783969299.150627:0:7477:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1783969299.150744:0:7477:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1783969299.150768:0:7477:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1783969299.151758:0:7477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1783969299.151770:0:7477:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783969299.151781:0:7477:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbacf56d076faabff 00000020:01000004:3.0:1783969299.151789:0:7477:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1783969299.151809:0:7477:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.139@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783969299.151813:0:7477:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783969299.151819:0:7477:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1783969299.151851:0:7477:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1783969299.151856:0:7477:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.139@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1783969299.181470:0:7477:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.139@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783969299.181503:0:7477:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.139@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1783969299.181507:0:7477:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783969299.181509:0:7477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783969299.181510:0:7477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969299.181511:0:7477:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969299.181513:0:7477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969299.181514:0:7477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969299.181515:0:7477:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783969299.181517:0:7477:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783969299.181518:0:7477:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783969299.181519:0:7477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969299.181521:0:7477:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783969299.181524:0:7477:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1783969299.181526:0:7477:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783969299.181527:0:7477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783969299.181528:0:7477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969299.181529:0:7477:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969299.181531:0:7477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969299.181532:0:7477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969299.181533:0:7477:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783969299.181534:0:7477:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783969299.181535:0:7477:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783969299.181536:0:7477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969299.181537:0:7477:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783969299.181561:0:7477:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1783969299.181578:0:7477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba612d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280532992:0@lo:253: 00000100:00100000:2.0:1783969299.183491:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969299.183606:0:7477:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac798f3e300 going to sleep for 11 seconds 00000100:00100000:3.0:1783969299.183856:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280532992 00000100:00100000:3.0:1783969299.183891:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280532992 00000100:00100000:3.0:1783969299.183954:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783969299.183963:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+16:7477:x1870627280532992:12345-0@lo:253: 20000000:01000000:3.0:1783969299.183995:0:5788:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1783969299.184000:0:5788:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1783969299.184004:0:5788:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1783969299.184008:0:5788:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1783969299.185711:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783969299.186241:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1783969299.186256:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1783969299.186294:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1783969299.186301:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1783969299.186325:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1783969299.186492:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1783969299.187044:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1783969299.187062:0:5788:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.139@tcp 20000000:01000000:3.0:1783969299.187065:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.139@tcp (null) (null) (null) 00000040:00080000:3.0:1783969299.187094:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1783969299.187100:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1783969299.187138:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1783969299.187701:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.139@tcp (null) (null) 00000040:00080000:3.0:1783969299.187749:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1783969299.187758:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1783969299.187782:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1783969299.187830:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1783969299.190890:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1783969299.190922:0:5788:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.139@tcp 20000000:01000000:3.0:1783969299.190925:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.139@tcp (null) (null) (null) 00000040:00080000:3.0:1783969299.190965:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1783969299.190973:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1783969299.191006:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1783969299.191014:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.139@tcp (null) (null) 00000040:00080000:3.0:1783969299.191045:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1783969299.191055:0:5788:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1783969299.191116:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1783969299.191727:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1783969299.191753:0:5788:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1783969299.191756:0:5788:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1783969299.191762:0:5788:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1783969299.191763:0:5788:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1783969299.191766:0:5788:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1783969299.191779:0:5788:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1783969299.191782:0:5788:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1783969299.191822:0:5788:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1783969299.191824:0:5788:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783969299.193029:0:7479:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1783969299.193106:0:7479:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1783969299.193239:0:7479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1783969299.193625:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1783969299.193760:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1783969299.193799:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1783969299.193810:0:5788:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1783969299.193813:0:5788:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783969299.194824:0:7480:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1783969299.194919:0:7480:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1783969299.194976:0:7480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1783969299.195315:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1783969299.195354:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1783969299.195479:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1783969299.195493:0:5788:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1783969299.195495:0:5788:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1783969299.195982:0:7481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1783969299.196258:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1783969299.196297:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1783969299.196353:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1783969299.196415:0:5788:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1783969299.196418:0:5788:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783969299.197261:0:7482:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1783969299.197336:0:7482:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1783969299.197426:0:7482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1783969299.197777:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1783969299.197819:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1783969299.198320:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:0.0:1783969299.198342:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1783969299.198402:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac780031200/0xbacf56d076faac06 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.198420:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac783de7e00/0xbacf56d076faab49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faab42 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.198428:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac781496a00/0xbacf56d076faab73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faab6c expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.198435:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac780030600/0xbacf56d076faab9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faab96 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.198442:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac783de7400/0xbacf56d076faabb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faabb2 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.198449:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac781497200/0xbacf56d076faabf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faabea expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.198457:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ac780031200/0xbacf56d076faac06 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.198512:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac781497200/0xbacf56d076faabf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faabea expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.198525:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac781497200/0xbacf56d076faabf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faabea expref: 16 pid: 5787 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969299.198541:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a80380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5788:1870627280533120:0@lo:104: 00000100:00100000:0.0:1783969299.198607:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783969299.198769:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac783de7400/0xbacf56d076faabb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faabb2 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.198777:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac783de7400/0xbacf56d076faabb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faabb2 expref: 16 pid: 5786 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969299.198787:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a81880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5788:1870627280533248:0@lo:104: 00010000:00010000:0.0:1783969299.198810:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac780030600/0xbacf56d076faab9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faab96 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.198818:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac780030600/0xbacf56d076faab9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faab96 expref: 16 pid: 5786 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969299.198825:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a81f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5788:1870627280533376:0@lo:104: 00010000:00010000:0.0:1783969299.198854:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac781496a00/0xbacf56d076faab73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faab6c expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.198908:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac781496a00/0xbacf56d076faab73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faab6c expref: 16 pid: 5787 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969299.198917:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a81500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5788:1870627280533504:0@lo:104: 00010000:00010000:0.0:1783969299.198958:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac783de7e00/0xbacf56d076faab49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faab42 expref: 16 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.198966:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac783de7e00/0xbacf56d076faab49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faab42 expref: 16 pid: 5786 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969299.198974:0:5788:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a83800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5788:1870627280533632:0@lo:104: 00000100:00100000:0.0:1783969299.198992:0:5788:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7883b76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969299.199062:0:5777:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783969299.199082:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969299.199162:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969299.199270:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969299.199289:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280533120 00000100:00100000:1.0:1783969299.199296:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280533120 00000100:00100000:1.0:1783969299.199330:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280533248 00000100:00100000:1.0:1783969299.199333:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280533248 00000100:00100000:1.0:1783969299.199343:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280533376 00000100:00100000:1.0:1783969299.199345:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280533376 00000100:00100000:1.0:1783969299.199358:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783969299.199424:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78c717850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+5:5788:x1870627280533120:12345-0@lo:104: 00010000:00010000:1.0:1783969299.199437:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faabea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faabf1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.199535:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783969299.199542:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78c717850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+5:5788:x1870627280533120:12345-0@lo:104: Request processed in 120us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969299.199549:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783969299.199596:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783969299.199602:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba613b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+4:5788:x1870627280533248:12345-0@lo:104: 00010000:00010000:1.0:1783969299.199609:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faabb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faabb9 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.199721:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969299.199727:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faabea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faabf1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.199735:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac781497a00 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:3.0:1783969299.199739:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faabea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faabf1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.199746:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faabea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faabf1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969299.199753:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faabea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faabf1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969299.199759:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969299.199788:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faabea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faabf1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.199802:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969299.199826:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faabea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faabf1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.199834:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faabea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faabf1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.199857:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969299.199877:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969299.199879:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969299.199887:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969299.199898:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280533760:0@lo:103: 00000100:00100000:3.0:1783969299.199927:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783969299.200007:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783969299.200013:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba613b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+4:5788:x1870627280533248:12345-0@lo:104: Request processed in 412us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969299.200020:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783969299.200033:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783969299.200039:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba611c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+3:5788:x1870627280533376:12345-0@lo:104: 00010000:00010000:1.0:1783969299.200046:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3400/0xbacf56d076faab96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faab9d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.200087:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783969299.200092:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba611c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+3:5788:x1870627280533376:12345-0@lo:104: Request processed in 54us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969299.200098:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783969299.200122:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280533760 00000100:00100000:1.0:1783969299.200126:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280533760 00010000:00010000:1.0:1783969299.200140:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac781497200/0xbacf56d076faabf1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faabea expref: 17 pid: 5787 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.200226:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783969299.200231:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faabb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faabb9 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.200238:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6800 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:3.0:1783969299.200241:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faabb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faabb9 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.200248:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faabb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faabb9 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969299.200255:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faabb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faabb9 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969299.200261:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969299.200282:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faabb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faabb9 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.200294:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969299.200308:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faabb2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faabb9 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.200314:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faabb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faabb9 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.200324:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969299.200327:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3400/0xbacf56d076faab96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faab9d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.200332:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c21e3400 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:3.0:1783969299.200335:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3400/0xbacf56d076faab96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faab9d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.200342:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3400/0xbacf56d076faab96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faab9d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969299.200348:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3400/0xbacf56d076faab96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faab9d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969299.200354:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969299.200376:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3400/0xbacf56d076faab96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faab9d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.200382:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969299.200387:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3400/0xbacf56d076faab96 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faab9d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.200393:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3400/0xbacf56d076faab96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faab9d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.200408:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969299.200410:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969299.200412:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969299.200423:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280533888:0@lo:103: 00000100:00100000:3.0:1783969299.200450:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969299.200470:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969299.200476:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280534016:0@lo:103: 00000100:00100000:3.0:1783969299.200509:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969299.200601:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280533888 00000100:00100000:1.0:1783969299.200604:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280533888 00010000:00010000:1.0:1783969299.200618:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac783de7400/0xbacf56d076faabb9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faabb2 expref: 18 pid: 5786 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969299.200640:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280534016 00000100:00100000:1.0:1783969299.200643:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280534016 00010000:00010000:1.0:1783969299.200653:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac780030600/0xbacf56d076faab9d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faab96 expref: 19 pid: 5786 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969299.200667:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783969299.200673:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785317800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c893ad09-f78f-4711-bea5-6489668294ed+19:3287:x1870627280533760:12345-0@lo:103: 00010000:00010000:1.0:1783969299.200682:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969299.200688:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac781497200/0xbacf56d076faabf1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faabea expref: 19 pid: 5787 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.200698:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac781497200/0xbacf56d076faabf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faabea expref: 19 pid: 5787 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.200715:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969299.200760:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785317800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c893ad09-f78f-4711-bea5-6489668294ed+19:3287:x1870627280533760:12345-0@lo:103: Request processed in 87us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969299.200766:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783969299.200780:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783969299.200785:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785316a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c893ad09-f78f-4711-bea5-6489668294ed+18:3285:x1870627280533888:12345-0@lo:103: 00010000:00010000:1.0:1783969299.200793:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969299.200797:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac783de7400/0xbacf56d076faabb9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faabb2 expref: 18 pid: 5786 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.200806:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac783de7400/0xbacf56d076faabb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faabb2 expref: 18 pid: 5786 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.200815:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969299.200853:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785316a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c893ad09-f78f-4711-bea5-6489668294ed+18:3285:x1870627280533888:12345-0@lo:103: Request processed in 67us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969299.200883:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783969299.200896:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783969299.200903:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785314380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c893ad09-f78f-4711-bea5-6489668294ed+17:3285:x1870627280534016:12345-0@lo:103: 00010000:00010000:1.0:1783969299.200910:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969299.200914:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac780030600/0xbacf56d076faab9d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faab96 expref: 17 pid: 5786 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.200923:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac780030600/0xbacf56d076faab9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faab96 expref: 17 pid: 5786 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.200933:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969299.200953:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785314380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c893ad09-f78f-4711-bea5-6489668294ed+17:3285:x1870627280534016:12345-0@lo:103: Request processed in 52us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969299.200959:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783969299.201009:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785315180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280534016:0@lo:103: 00000100:00100000:1.0:1783969299.201018:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280533888:0@lo:103: 00010000:00010000:1.0:1783969299.201036:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969299.201227:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280533760:0@lo:103: 00000100:00100000:2.0:1783969299.201302:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969299.201314:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280533504 00000100:00100000:2.0:1783969299.201317:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280533504 00000100:00100000:2.0:1783969299.201334:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280533632 00000100:00100000:2.0:1783969299.201337:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280533632 00000100:00100000:2.0:1783969299.201347:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783969299.201353:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba610700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c893ad09-f78f-4711-bea5-6489668294ed+4:5788:x1870627280533504:12345-0@lo:104: 00010000:00010000:2.0:1783969299.201471:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faab6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faab73 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969299.201517:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783969299.201523:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba610700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c893ad09-f78f-4711-bea5-6489668294ed+4:5788:x1870627280533504:12345-0@lo:104: Request processed in 170us (2252us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969299.201529:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783969299.201543:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783969299.201549:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba612a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c893ad09-f78f-4711-bea5-6489668294ed+3:5788:x1870627280533632:12345-0@lo:104: 00010000:00010000:2.0:1783969299.201555:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac780030400/0xbacf56d076faab42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faab49 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969299.201588:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783969299.201592:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba612a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c893ad09-f78f-4711-bea5-6489668294ed+3:5788:x1870627280533632:12345-0@lo:104: Request processed in 44us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969299.201597:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1783969299.201644:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783969299.201649:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faab6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faab73 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.201656:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c21e2a00 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:3.0:1783969299.201659:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faab6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faab73 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.201665:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faab6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faab73 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969299.201671:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faab6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faab73 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969299.201676:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969299.201703:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faab6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faab73 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.201709:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969299.201725:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faab6c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faab73 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.201731:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faab6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faab73 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.201741:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969299.201743:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac780030400/0xbacf56d076faab42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faab49 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.201748:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac780030400 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:3.0:1783969299.201751:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac780030400/0xbacf56d076faab42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faab49 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.201757:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac780030400/0xbacf56d076faab42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faab49 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969299.201762:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac780030400/0xbacf56d076faab42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faab49 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969299.201766:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969299.201777:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac780030400/0xbacf56d076faab42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faab49 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.201782:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969299.201786:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac780030400/0xbacf56d076faab42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faab49 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.201792:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac780030400/0xbacf56d076faab42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faab49 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.201805:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969299.201811:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969299.201813:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969299.201824:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280534144:0@lo:103: 00000100:00100000:3.0:1783969299.201879:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969299.201906:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969299.201912:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280534272:0@lo:103: 00000100:00100000:3.0:1783969299.201932:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969299.202079:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280534144 00000100:00100000:1.0:1783969299.202084:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280534144 00010000:00010000:1.0:1783969299.202101:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac781496a00/0xbacf56d076faab73 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faab6c expref: 17 pid: 5787 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969299.202127:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280534272 00000100:00100000:1.0:1783969299.202130:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280534272 00010000:00010000:1.0:1783969299.202141:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac783de7e00/0xbacf56d076faab49 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faab42 expref: 18 pid: 5786 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969299.202230:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783969299.202237:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785316300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c893ad09-f78f-4711-bea5-6489668294ed+18:3287:x1870627280534144:12345-0@lo:103: 00010000:00010000:2.0:1783969299.202247:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969299.202252:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac781496a00/0xbacf56d076faab73 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faab6c expref: 18 pid: 5787 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969299.202269:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac781496a00/0xbacf56d076faab73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faab6c expref: 18 pid: 5787 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969299.202281:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969299.202317:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785316300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c893ad09-f78f-4711-bea5-6489668294ed+18:3287:x1870627280534144:12345-0@lo:103: Request processed in 80us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969299.202323:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783969299.202383:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783969299.202389:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785315c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c893ad09-f78f-4711-bea5-6489668294ed+17:3287:x1870627280534272:12345-0@lo:103: 00010000:00010000:1.0:1783969299.202397:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969299.202401:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac783de7e00/0xbacf56d076faab49 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faab42 expref: 17 pid: 5786 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.202410:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac783de7e00/0xbacf56d076faab49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faab42 expref: 17 pid: 5786 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.202423:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ac780031200/0xbacf56d076faac06 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.202430:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac780031200/0xbacf56d076faac06 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.202446:0:5780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac780031200/0xbacf56d076faac06 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.202463:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac780031200/0xbacf56d076faac06 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.202469:0:5780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac780031200/0xbacf56d076faac06 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.202475:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac780031200/0xbacf56d076faac06 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.202481:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac780031200 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969299.202484:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac780031200/0xbacf56d076faac06 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.202491:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac780031200/0xbacf56d076faac06 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.202500:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac780031200/0xbacf56d076faac06 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.202509:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969299.202535:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785315c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c893ad09-f78f-4711-bea5-6489668294ed+17:3287:x1870627280534272:12345-0@lo:103: Request processed in 146us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969299.202541:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1783969299.202557:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969299.202712:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280534272:0@lo:103: 00000100:00100000:3.0:1783969299.202721:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280534144:0@lo:103: 00010000:00010000:0.0:1783969299.202808:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac781497200/0xbacf56d076faabf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faabea expref: 16 pid: 5787 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969299.202821:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a80380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5788:1870627280533120:0@lo:104: 00010000:00010000:0.0:1783969299.202856:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac783de7400/0xbacf56d076faabb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faabb2 expref: 15 pid: 5786 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969299.203066:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a81880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5788:1870627280533248:0@lo:104: 00010000:00010000:0.0:1783969299.203456:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac780030600/0xbacf56d076faab9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faab96 expref: 14 pid: 5786 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969299.203467:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a81f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5788:1870627280533376:0@lo:104: 00010000:00010000:0.0:1783969299.203477:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac781496a00/0xbacf56d076faab73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faab6c expref: 13 pid: 5787 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969299.203485:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a81500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5788:1870627280533504:0@lo:104: 00010000:00010000:0.0:1783969299.203493:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac783de7e00/0xbacf56d076faab49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faab42 expref: 12 pid: 5786 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969299.203501:0:5788:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a83800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5788:1870627280533632:0@lo:104: 00010000:00010000:0.0:1783969299.203531:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ac780031200/0xbacf56d076faac06 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.203540:0:5788:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ac780031200/0xbacf56d076faac06 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.203547:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac780031200/0xbacf56d076faac06 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.203553:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac780031200/0xbacf56d076faac06 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783969299.203565:0:5788:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1783969299.249344:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+11:7477:x1870627280532992:12345-0@lo:253: Request processed in 65374us (65851us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969299.249359:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783969299.249521:0:7477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba612d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280532992:0@lo:253: 10000000:01000000:1.0:1783969299.249535:0:7477:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783969299.249538:0:7477:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783969299.249539:0:7477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783969299.249540:0:7477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783969299.249541:0:7477:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1783969299.249555:0:7477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783969299.249557:0:7477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783969299.249558:0:7477:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783969299.249559:0:7477:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1783969299.249561:0:7477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783969299.249562:0:7477:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783969299.249598:0:7477:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ac7bf7a8800 from lustre-OST0001 10000000:01000000:1.0:1783969299.249621:0:7477:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1783969299.249624:0:7477:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1783969299.249642:0:7477:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ac7917f19c0 local copy 10000000:01000000:1.0:1783969299.249647:0:7477:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783969299.249682:0:7477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781496e00/0xbacf56d076faac0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.249694:0:7477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.139@tcp lock: ffff9ac781496e00/0xbacf56d076faac0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.249703:0:7477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac781496e00/0xbacf56d076faac0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969299.249723:0:7477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798164a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280534400:0@lo:101: 00000100:00100000:1.0:1783969299.249757:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969299.249795:0:7477:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bf74c600 going to sleep for 11 seconds 00000100:00100000:0.0:1783969299.249920:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280534400 00000100:00100000:0.0:1783969299.249926:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280534400 00000100:00100000:0.0:1783969299.249977:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783969299.249986:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+11:7477:x1870627280534400:12345-0@lo:101: 00010000:00010000:0.0:1783969299.249999:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969299.250014:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac780031200/0xbacf56d076faac14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faac0d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.250038:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac780031200/0xbacf56d076faac14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faac0d expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.250048:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac780031200/0xbacf56d076faac14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faac0d expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.250069:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac780031200, rc 0) 00000100:00100000:0.0:1783969299.250100:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+12:7477:x1870627280534400:12345-0@lo:101: Request processed in 115us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969299.250105:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783969299.250290:0:7477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798164a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280534400:0@lo:101: 00010000:00010000:1.0:1783969299.250304:0:7477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac781496e00/0xbacf56d076faac0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xbacf56d076faac14 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.250312:0:7477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac781496e00/0xbacf56d076faac0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbacf56d076faac14 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969299.250404:0:7477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798164a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280534528:0@lo:501: 00000100:00100000:1.0:1783969299.250433:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969299.250469:0:7477:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bf74c600 going to sleep for 11 seconds 00000100:00100000:0.0:1783969299.250517:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280534528 00000100:00100000:0.0:1783969299.250522:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280534528 00000100:00100000:0.0:1783969299.250553:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783969299.250561:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+12:7477:x1870627280534528:12345-0@lo:501: 00000100:00100000:0.0:1783969299.250768:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+12:7477:x1870627280534528:12345-0@lo:501: Request processed in 206us (333us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783969299.250775:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783969299.250807:0:7477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798164a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280534528:0@lo:501: 10000000:01000000:0.0:1783969299.250819:0:7477:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783969299.250855:0:7477:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783969299.250886:0:7477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781496e00/0xbacf56d076faac0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbacf56d076faac14 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.250895:0:7477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781496e00/0xbacf56d076faac0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbacf56d076faac14 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.250902:0:7477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9ac781496e00/0xbacf56d076faac0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbacf56d076faac14 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.250917:0:7477:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783969299.250947:0:7477:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ac7bf7a8800 10000000:01000000:0.0:1783969299.250952:0:7477:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783969299.250965:0:7477:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783969299.250967:0:7477:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783969299.250971:0:7477:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1783969299.250984:0:7477:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783969299.251003:0:7477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac780030600/0xbacf56d076faac1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.251010:0:7477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac780030600/0xbacf56d076faac1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.251018:0:7477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac780030600/0xbacf56d076faac1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969299.251031:0:7477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280534656:0@lo:101: 00000100:00100000:0.0:1783969299.251056:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969299.251079:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280534656 00000100:00100000:0.0:1783969299.251083:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280534656 00000100:00100000:0.0:1783969299.251105:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783969299.251110:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+12:7477:x1870627280534656:12345-0@lo:101: 00010000:00010000:0.0:1783969299.251117:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969299.251128:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac780031600/0xbacf56d076faac22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faac1b expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.251636:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac780031600/0xbacf56d076faac22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faac1b expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.251648:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac780031600/0xbacf56d076faac22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faac1b expref: 13 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.251661:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac780031600, rc 0) 00000100:00100000:0.0:1783969299.251701:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+13:7477:x1870627280534656:12345-0@lo:101: Request processed in 590us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969299.251708:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783969299.251742:0:7477:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7883b7300 going to sleep for 11 seconds 00000100:00100000:0.0:1783969299.251757:0:7477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280534656:0@lo:101: 00010000:00010000:0.0:1783969299.251770:0:7477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac780030600/0xbacf56d076faac1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faac22 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.251779:0:7477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac780030600/0xbacf56d076faac1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faac22 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969299.251884:0:7477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280534784:0@lo:501: 00000100:00100000:0.0:1783969299.251910:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969299.251936:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280534784 00000100:00100000:0.0:1783969299.251940:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280534784 00000100:00100000:0.0:1783969299.251962:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783969299.251969:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+13:7477:x1870627280534784:12345-0@lo:501: 00000100:00100000:0.0:1783969299.252264:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+13:7477:x1870627280534784:12345-0@lo:501: Request processed in 173us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969299.252274:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783969299.252301:0:7477:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7883b7300 going to sleep for 11 seconds 00000100:00100000:0.0:1783969299.252313:0:7477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280534784:0@lo:501: 00000100:00100000:0.0:1783969299.252337:0:7477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280534912:0@lo:503: 00000100:00100000:0.0:1783969299.252371:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969299.252390:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280534912 00000100:00100000:0.0:1783969299.252394:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280534912 00000100:00100000:0.0:1783969299.252414:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783969299.252429:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+13:7477:x1870627280534912:12345-0@lo:503: 00000100:00100000:0.0:1783969299.252551:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+13:7477:x1870627280534912:12345-0@lo:503: Request processed in 123us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969299.252558:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783969299.252583:0:7477:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7883b7300 going to sleep for 11 seconds 00000100:00100000:0.0:1783969299.252595:0:7477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280534912:0@lo:503: 00010000:00010000:3.0:1783969299.252756:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969299.252764:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac781496e00/0xbacf56d076faac0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbacf56d076faac14 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.252772:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac781496e00 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:3.0:1783969299.252777:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac781496e00/0xbacf56d076faac0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbacf56d076faac14 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.252785:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac781496e00/0xbacf56d076faac0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xbacf56d076faac14 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969299.252792:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac781496e00/0xbacf56d076faac0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xbacf56d076faac14 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969299.252798:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969299.252819:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac781496e00/0xbacf56d076faac0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbacf56d076faac14 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.252825:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969299.252856:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac781496e00/0xbacf56d076faac0d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbacf56d076faac14 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.252892:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac781496e00/0xbacf56d076faac0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbacf56d076faac14 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.252905:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969299.252907:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969299.252909:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969299.252959:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783969299.252971:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280535040:0@lo:103: 00000100:00100000:0.0:1783969299.253000:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1783969299.253415:0:7477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783969299.253472:0:7477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280535168:0@lo:502: 00000100:00100000:0.0:1783969299.253508:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969299.253536:0:7477:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7883b7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783969299.253590:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280535040 00000100:00100000:3.0:1783969299.253595:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280535040 00000100:00100000:3.0:1783969299.253642:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783969299.253650:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c893ad09-f78f-4711-bea5-6489668294ed+13:3286:x1870627280535040:12345-0@lo:103: 00010000:00010000:3.0:1783969299.253660:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969299.253674:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac780031200/0xbacf56d076faac14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbacf56d076faac0d expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.253687:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969299.253718:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c893ad09-f78f-4711-bea5-6489668294ed+12:3286:x1870627280535040:12345-0@lo:103: Request processed in 69us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969299.253725:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783969299.253835:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280535168 00000100:00100000:1.0:1783969299.253849:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280535168 00000100:00100000:1.0:1783969299.253902:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783969299.253909:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+12:7477:x1870627280535168:12345-0@lo:502: 00000100:00100000:1.0:1783969299.254064:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+12:7477:x1870627280535168:12345-0@lo:502: Request processed in 155us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969299.254070:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783969299.254289:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280535040:0@lo:103: 00000100:00100000:0.0:1783969299.254321:0:7477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280535168:0@lo:502: 00000040:00080000:0.0:1783969299.254567:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1783969299.254617:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1783969299.254923:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1783969299.255087:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1783969299.255130:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1783969299.255243:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1783969299.255277:0:7477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280535296:0@lo:502: 00000100:00100000:0.0:1783969299.255334:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969299.255419:0:7477:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7883b7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783969299.255573:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280535296 00000100:00100000:1.0:1783969299.255579:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280535296 00000100:00100000:1.0:1783969299.255715:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783969299.255724:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+12:7477:x1870627280535296:12345-0@lo:502: 00000100:00100000:1.0:1783969299.255925:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+12:7477:x1870627280535296:12345-0@lo:502: Request processed in 201us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969299.255932:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783969299.256020:0:7477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280535296:0@lo:502: 00000040:00080000:2.0:1783969299.256111:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1783969299.256122:0:7477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1783969299.256575:0:7483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783969299.256584:0:7483:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1783969299.256590:0:7483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969299.256593:0:7483:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1783969299.256597:0:7483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783969299.256618:0:7483:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ac7ba654d40) 00000020:00000080:2.0:1783969299.256648:0:7483:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783969299.256654:0:7483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783969299.256719:0:7483:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac7bf7a8800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1783969299.256727:0:7483:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783969299.256733:0:7483:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbacf56d076faac30 00010000:00010000:2.0:1783969299.259768:0:7483:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1783969299.262648:0:7483:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1783969299.264937:0:7483:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1783969299.265195:0:7483:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1783969299.275474:0:7483:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1783969299.276248:0:7483:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1783969299.277794:0:7483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1783969299.277805:0:7483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969299.277811:0:7483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969299.277813:0:7483:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1783969299.277816:0:7483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969299.277820:0:7483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969299.277822:0:7483:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783969299.277825:0:7483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783969299.277826:0:7483:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783969299.277900:0:7483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969299.277904:0:7483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969299.277905:0:7483:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783969299.277908:0:7483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1783969299.278235:0:7477:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1783969299.278260:0:7477:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783969299.278330:0:7477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac780030600/0xbacf56d076faac1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faac22 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.278343:0:7477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac780030600/0xbacf56d076faac1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faac22 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969299.278365:0:7477:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ac7bf7a8800 from 1 10000000:01000000:3.0:1783969299.278368:0:7477:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783969299.278403:0:7477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faac37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.278411:0:7477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faac37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.278421:0:7477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faac37 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969299.278442:0:7477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785316680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280535424:0@lo:101: 00000100:00100000:3.0:1783969299.278508:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969299.278549:0:7477:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bff113c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969299.278600:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280535424 00000100:00100000:0.0:1783969299.278607:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280535424 00000100:00100000:0.0:1783969299.278720:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783969299.278730:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+12:7477:x1870627280535424:12345-0@lo:101: 00010000:00010000:0.0:1783969299.278744:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969299.278756:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac780030c00/0xbacf56d076faac3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faac37 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.278780:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac780030c00/0xbacf56d076faac3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faac37 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.278791:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac780030c00/0xbacf56d076faac3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faac37 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.278799:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac780030c00, rc 0) 00000100:00100000:0.0:1783969299.278852:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+13:7477:x1870627280535424:12345-0@lo:101: Request processed in 124us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969299.278878:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783969299.278931:0:7477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785316680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280535424:0@lo:101: 00010000:00010000:0.0:1783969299.278947:0:7477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faac37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faac3e expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.278955:0:7477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faac37 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faac3e expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969299.279038:0:7477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a81f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280535552:0@lo:501: 00000100:00100000:0.0:1783969299.279064:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969299.279079:0:7477:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7a0294a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783969299.279137:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280535552 00000100:00100000:3.0:1783969299.279210:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280535552 00000100:00100000:3.0:1783969299.279242:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783969299.279250:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+13:7477:x1870627280535552:12345-0@lo:501: 00000100:00100000:3.0:1783969299.279449:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+13:7477:x1870627280535552:12345-0@lo:501: Request processed in 200us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969299.279457:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783969299.280285:0:7477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a81f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280535552:0@lo:501: 00000100:00100000:0.0:1783969299.280329:0:7477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a81f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280535680:0@lo:503: 00000100:00100000:0.0:1783969299.280382:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969299.280410:0:7477:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7a0294a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783969299.280483:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280535680 00000100:00100000:3.0:1783969299.280489:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280535680 00000100:00100000:3.0:1783969299.280529:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783969299.280537:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+13:7477:x1870627280535680:12345-0@lo:503: 00000100:00100000:3.0:1783969299.280983:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+13:7477:x1870627280535680:12345-0@lo:503: Request processed in 446us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969299.281002:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783969299.281263:0:7477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a81f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280535680:0@lo:503: 00000040:00080000:0.0:1783969299.281531:0:7477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783969299.281595:0:7477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a81f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280535808:0@lo:502: 00000100:00100000:0.0:1783969299.282605:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969299.282733:0:7477:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7a0294a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783969299.282826:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280535808 00000100:00100000:1.0:1783969299.282833:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280535808 00000100:00100000:1.0:1783969299.282894:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783969299.282903:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+13:7477:x1870627280535808:12345-0@lo:502: 00000100:00100000:1.0:1783969299.283135:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+13:7477:x1870627280535808:12345-0@lo:502: Request processed in 232us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969299.283320:0:7477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a81f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280535808:0@lo:502: 00000040:00080000:0.0:1783969299.283620:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000100:00100000:1.0:1783969299.284275:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000040:00080000:0.0:1783969299.284815:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1783969299.284925:0:7477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a81f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280535936:0@lo:502: 00000100:00100000:0.0:1783969299.284987:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969299.285065:0:7477:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7a0294a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783969299.293741:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280535936 00000100:00100000:3.0:1783969299.293756:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280535936 00000100:00100000:3.0:1783969299.293813:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783969299.293825:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+13:7477:x1870627280535936:12345-0@lo:502: 00000100:00100000:3.0:1783969299.294087:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+13:7477:x1870627280535936:12345-0@lo:502: Request processed in 263us (9099us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969299.294095:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783969299.294387:0:7477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a81f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280535936:0@lo:502: 00000040:00080000:0.0:1783969299.294537:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1783969299.294553:0:7477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1783969299.295286:0:7487:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969299.295294:0:7487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969299.295297:0:7487:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783969299.295303:0:7487:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac7bf7a8800 00000020:00000080:1.0:1783969299.295306:0:7487:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783969299.295322:0:7487:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969299.295324:0:7487:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969299.295330:0:7487:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1783969299.295333:0:7487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1783969299.295887:0:7477:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1783969299.295909:0:7477:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783969299.295925:0:7477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faac37 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faac3e expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.295936:0:7477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faac37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faac3e expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969299.295975:0:7477:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783969299.295977:0:7477:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ac7bf7a8800 10000000:01000000:3.0:1783969299.295980:0:7477:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ac7bf7a8800 10000000:01000000:3.0:1783969299.295983:0:7477:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783969299.295989:0:7477:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ac7bf7a8800 from 1 10000000:01000000:3.0:1783969299.295991:0:7477:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783969299.296021:0:7477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de6a00/0xbacf56d076faac45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.296029:0:7477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac783de6a00/0xbacf56d076faac45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.296039:0:7477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac783de6a00/0xbacf56d076faac45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969299.296065:0:7477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785315880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280536064:0@lo:101: 00000100:00100000:3.0:1783969299.296116:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969299.296207:0:7477:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba11bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783969299.296262:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280536064 00000100:00100000:2.0:1783969299.296268:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280536064 00000100:00100000:2.0:1783969299.296306:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783969299.296313:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+13:7477:x1870627280536064:12345-0@lo:101: 00010000:00010000:2.0:1783969299.296324:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969299.296335:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7c21e2a00/0xbacf56d076faac4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faac45 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969299.296364:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7c21e2a00/0xbacf56d076faac4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faac45 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969299.296374:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7c21e2a00/0xbacf56d076faac4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faac45 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969299.296382:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c21e2a00, rc 0) 00000100:00100000:2.0:1783969299.296413:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+14:7477:x1870627280536064:12345-0@lo:101: Request processed in 100us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969299.296419:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783969299.296532:0:7477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785315880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280536064:0@lo:101: 00010000:00010000:3.0:1783969299.296545:0:7477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac783de6a00/0xbacf56d076faac45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faac4c expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969299.296554:0:7477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac783de6a00/0xbacf56d076faac45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faac4c expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969299.296620:0:7477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785315880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280536192:0@lo:501: 00000100:00100000:3.0:1783969299.296707:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969299.296736:0:7477:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba11bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1783969299.296750:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280536192 00000100:00100000:3.0:1783969299.296754:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280536192 00000100:00100000:3.0:1783969299.296775:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783969299.296780:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+14:7477:x1870627280536192:12345-0@lo:501: 00000100:00100000:3.0:1783969299.297000:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+14:7477:x1870627280536192:12345-0@lo:501: Request processed in 218us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969299.297006:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783969299.297036:0:7477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785315880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280536192:0@lo:501: 00000100:00100000:3.0:1783969299.297062:0:7477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785315880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280536320:0@lo:503: 00000100:00100000:3.0:1783969299.297097:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969299.297110:0:7477:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba11bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1783969299.297123:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280536320 00000100:00100000:3.0:1783969299.297133:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280536320 00000100:00100000:3.0:1783969299.297276:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783969299.297283:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+14:7477:x1870627280536320:12345-0@lo:503: 00000100:00100000:3.0:1783969299.297418:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+14:7477:x1870627280536320:12345-0@lo:503: Request processed in 135us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969299.297424:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783969299.297462:0:7477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785315880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280536320:0@lo:503: 00000040:00080000:3.0:1783969299.298026:0:7477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783969299.298112:0:7477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785315880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280536448:0@lo:502: 00000100:00100000:3.0:1783969299.298225:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969299.298291:0:7477:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba11bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783969299.298451:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280536448 00000100:00100000:2.0:1783969299.298457:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280536448 00000100:00100000:3.0:1783969299.298590:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783969299.298598:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+14:7477:x1870627280536448:12345-0@lo:502: 00000100:00100000:3.0:1783969299.298903:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+14:7477:x1870627280536448:12345-0@lo:502: Request processed in 304us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969299.298910:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1783969299.298997:0:7477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785315880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280536448:0@lo:502: 00000040:00080000:0.0:1783969299.299266:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1783969299.299323:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1783969299.299359:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1783969299.299401:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1783969299.299436:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1783969299.299486:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1783969299.299540:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1783969299.299578:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1783969299.299628:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1783969299.299811:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1783969299.299883:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1783969299.299939:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1783969299.299980:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1783969299.300018:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1783969299.300069:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1783969299.300106:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1783969299.300206:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1783969299.300261:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1783969299.300297:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1783969299.300332:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1783969299.300380:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1783969299.300417:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1783969299.300470:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1783969299.300521:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1783969299.300560:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1783969299.300601:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1783969299.300740:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1783969299.300784:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1783969299.300831:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1783969299.300920:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1783969299.300958:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1783969299.300992:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1783969299.301026:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1783969299.301074:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1783969299.301109:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1783969299.301341:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1783969299.301383:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1783969299.301431:0:7477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a81f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280536576:0@lo:502: 00000100:00100000:0.0:1783969299.301505:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969299.301815:0:7477:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7a0294a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783969299.302278:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280536576 00000100:00100000:2.0:1783969299.302286:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280536576 00000100:00100000:2.0:1783969299.302324:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783969299.302333:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+14:7477:x1870627280536576:12345-0@lo:502: 00000100:00100000:2.0:1783969299.302563:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+14:7477:x1870627280536576:12345-0@lo:502: Request processed in 230us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969299.302570:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783969299.302852:0:7477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a81f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280536576:0@lo:502: 00000040:00080000:0.0:1783969299.302979:0:7477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1783969299.302991:0:7477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1783969299.303616:0:7488:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1783969299.303704:0:7488:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ac7ba653380) 00000020:00000080:2.0:1783969299.303726:0:7488:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1783969299.303970:0:7488:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac7bf7a8800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783969299.303974:0:7488:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ac7bf7a8800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783969299.303976:0:7488:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac7bf7a8800 3 00010000:00080000:2.0:1783969299.304003:0:7488:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ac7ba658800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.139@tcp at head 00010000:00010000:2.0:1783969299.311476:0:7488:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1783969299.311565:0:7488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1783969299.311603:0:7488:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783969299.311615:0:7488:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xbacf56d076faac5a 00000100:00080000:2.0:1783969299.311623:0:7488:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783969299.312721:0:7488:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ac7ba658800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1783969299.312755:0:7488:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac7ba612300 x1870627280536704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783969299.312779:0:7488:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783969299.312876:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783969299.312892:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1870627280536832:0@lo:400: 00000100:00100000:2.0:1783969299.312951:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969299.312988:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280536960:0@lo:400: 00000100:00100000:2.0:1783969299.313009:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969299.313027:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783969299.313032:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280537088:0@lo:400: 00000100:00100000:2.0:1783969299.313056:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969299.313087:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280536832 00000100:00100000:2.0:1783969299.313092:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280536832 00000100:00100000:2.0:1783969299.313127:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280536960 00000100:00100000:2.0:1783969299.313130:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280536960 00000100:00100000:0.0:1783969299.314268:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3284:1870627280536704:0@lo:38: 00000100:00100000:0.0:1783969299.314333:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969299.314397:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280536704 00000100:00100000:0.0:1783969299.314403:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280536704 00000100:00100000:0.0:1783969299.314423:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783969299.314433:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1870627280536832:12345-0@lo:400: 00000100:00100000:0.0:1783969299.314488:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba611f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1870627280536832:12345-0@lo:400: Request processed in 57us (1536us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969299.314495:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783969299.314513:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783969299.314517:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3284:x1870627280536704:12345-0@lo:38: 00010000:00080000:0.0:1783969299.314537:0:5793:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:0.0:1783969299.314568:0:5793:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xbacf56d076faac61 00000004:00100000:0.0:1783969299.314589:0:5793:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783969299.314621:0:5793:0:(import.c:65:import_set_state_nolock()) ffff9ac782f98800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783969299.314735:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1870627280536704:12345-0@lo:38: Request processed in 216us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969299.314742:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783969299.314780:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac7ba610380 x1870627280536832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969299.314793:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1870627280536832:0@lo:400: 00010000:00080000:0.0:1783969299.314833:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac7ba612300 x1870627280536704/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783969309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969299.314850:0:3284:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783969299.314856:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1783969299.314880:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783969299.314885:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783969299.314887:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9ac7ba658800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783969299.314893:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3284:1870627280536704:0@lo:38: 00000100:00100000:2.0:1783969299.315317:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783969299.315327:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280536960:12345-0@lo:400: 00000100:00100000:2.0:1783969299.315370:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280536960:12345-0@lo:400: Request processed in 46us (2359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969299.315376:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783969299.315399:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280537088 00000100:00100000:2.0:1783969299.315404:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280537088 00000100:00100000:2.0:1783969299.315435:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783969299.315441:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280537088:12345-0@lo:400: 00000100:00100000:2.0:1783969299.315483:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280537088:12345-0@lo:400: Request processed in 42us (2426us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969299.315490:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1783969299.315509:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783969299.315512:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783969299.315533:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac7ba610e00 x1870627280537088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969299.315544:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280537088:0@lo:400: 00010000:00080000:2.0:1783969299.315555:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac7ba611880 x1870627280536960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969299.315563:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280536960:0@lo:400: 00000040:00080000:2.0:1783969299.318410:0:7488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1783969299.318705:0:7490:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a81880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7490:1870627280537216:0@lo:901: 00000100:00100000:0.0:1783969299.318769:0:7490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969299.318801:0:7490:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7a0294540 going to sleep for 11 seconds 00000100:00100000:2.0:1783969299.318896:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280537216 00000100:00100000:2.0:1783969299.318903:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280537216 00000100:00100000:2.0:1783969299.318950:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783969299.318960:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7490:x1870627280537216:12345-0@lo:901: 00000100:00080000:3.0:1783969299.319245:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969299.319563:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7490:x1870627280537216:12345-0@lo:901: Request processed in 603us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969299.319572:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:1.0:1783969299.319704:0:7477:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1783969299.319738:0:7477:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783969299.319787:0:7477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de6a00/0xbacf56d076faac45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faac4c expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.319799:0:7477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac783de6a00/0xbacf56d076faac45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faac4c expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783969299.319853:0:7477:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783969299.319856:0:7477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783969299.319857:0:7477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783969299.319877:0:7477:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783969299.319878:0:7477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783969299.319880:0:7477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783969299.319881:0:7477:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783969299.319883:0:7477:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783969299.319884:0:7477:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783969299.319886:0:7477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783969299.319887:0:7477:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783969299.319891:0:7477:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1783969299.319893:0:7477:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783969299.319895:0:7477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783969299.319896:0:7477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783969299.319897:0:7477:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783969299.319898:0:7477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783969299.319899:0:7477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783969299.319900:0:7477:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783969299.319901:0:7477:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783969299.319902:0:7477:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783969299.319903:0:7477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783969299.319904:0:7477:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783969299.319921:0:7477:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783969299.319932:0:7477:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798165500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280537344:0@lo:253: 00000100:00100000:1.0:1783969299.319973:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969299.320009:0:7477:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bf74c540 going to sleep for 11 seconds 00000100:00100000:0.0:1783969299.320065:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280537344 00000100:00100000:0.0:1783969299.320070:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280537344 00000100:00100000:0.0:1783969299.320108:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783969299.320116:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+14:7477:x1870627280537344:12345-0@lo:253: 20000000:01000000:0.0:1783969299.320139:0:5787:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1783969299.320163:0:5787:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1783969299.322281:0:7490:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac7a7a81880 x1870627280537216/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1783969315 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969299.322298:0:7490:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a81880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7490:1870627280537216:0@lo:901: 20000000:01000000:0.0:1783969299.343347:0:5787:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783969299.343378:0:5787:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1783969299.343637:0:5809:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783969299.343642:0:5809:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783969299.343664:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac781497800/0xbacf56d076faac68 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.343682:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faabab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faaba4 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.343691:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ac781497800/0xbacf56d076faac68 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.343728:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faabab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faaba4 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969299.343741:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faabab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faaba4 expref: 14 pid: 5787 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969299.343755:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798164e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5809:1870627280537472:0@lo:104: 00000100:00100000:1.0:1783969299.343817:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969299.343891:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bf74ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969299.344032:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280537472 00000100:00100000:0.0:1783969299.344039:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280537472 00000100:00100000:0.0:1783969299.344088:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783969299.344096:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798164380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+3:5809:x1870627280537472:12345-0@lo:104: 00010000:00010000:0.0:1783969299.344107:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faaba4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faabab expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.344162:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783969299.344167:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798164380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+3:5809:x1870627280537472:12345-0@lo:104: Request processed in 73us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969299.344173:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1783969299.344194:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969299.344199:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faaba4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faabab expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.344206:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac781497400 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:0.0:1783969299.344210:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faaba4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faabab expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.344217:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faaba4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faabab expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969299.344224:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faaba4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faabab expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969299.344229:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783969299.344256:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faaba4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faabab expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.344262:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969299.344285:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faaba4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faabab expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.344292:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faaba4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faabab expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969299.344307:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969299.344309:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969299.344311:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969299.344322:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280537600:0@lo:103: 00000100:00100000:0.0:1783969299.344353:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969299.344449:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798164e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5809:1870627280537472:0@lo:104: 00010000:00010000:1.0:1783969299.344467:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ac781497800/0xbacf56d076faac68 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969299.346769:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280537600 00000100:00100000:2.0:1783969299.346783:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280537600 00010000:00010000:2.0:1783969299.346827:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faabab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faaba4 expref: 15 pid: 5787 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969299.346893:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783969299.346903:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a63850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c893ad09-f78f-4711-bea5-6489668294ed+15:3285:x1870627280537600:12345-0@lo:103: 00010000:00010000:2.0:1783969299.346934:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969299.346940:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faabab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faaba4 expref: 15 pid: 5787 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969299.346954:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faabab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faaba4 expref: 15 pid: 5787 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969299.346971:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faabab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faaba4 expref: 15 pid: 5787 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969299.346989:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ac781497800/0xbacf56d076faac68 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969299.346998:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac781497800/0xbacf56d076faac68 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783969299.347015:0:5778:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003372824s 00010000:00010000:2.0:1783969299.347020:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac781497800/0xbacf56d076faac68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969299.347027:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac781497800/0xbacf56d076faac68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969299.347034:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac781497800/0xbacf56d076faac68 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969299.347042:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac781497800/0xbacf56d076faac68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969299.347049:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac781497800 already unused, calling callback (ffffffffc1485230) 00010000:00010000:2.0:1783969299.347053:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac781497800/0xbacf56d076faac68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969299.347068:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac781497800/0xbacf56d076faac68 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969299.347085:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac781497800/0xbacf56d076faac68 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969299.347097:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969299.347181:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a63850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c893ad09-f78f-4711-bea5-6489668294ed+14:3285:x1870627280537600:12345-0@lo:103: Request processed in 279us (2826us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969299.347188:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1783969299.347246:0:5809:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ac781497800/0xbacf56d076faac68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969299.347254:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac781497800/0xbacf56d076faac68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969299.347261:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac781497800/0xbacf56d076faac68 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969299.347299:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280537600:0@lo:103: 00000100:00100000:0.0:1783969299.354382:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+13:7477:x1870627280537344:12345-0@lo:253: Request processed in 34258us (34400us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969299.354396:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783969299.354539:0:7477:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798165500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c893ad09-f78f-4711-bea5-6489668294ed:7477:1870627280537344:0@lo:253: 10000000:01000000:2.0:1783969299.354554:0:7477:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1783969299.354558:0:7477:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783969299.354559:0:7477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783969299.354560:0:7477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969299.354561:0:7477:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969299.354562:0:7477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969299.354563:0:7477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969299.354565:0:7477:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783969299.354566:0:7477:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783969299.354580:0:7477:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783969299.354582:0:7477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969299.354584:0:7477:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783969299.354603:0:7477:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1783969299.359845:0:7477:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1783969299.360127:0:7477:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1783969299.360383:0:7477:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1783969299.360573:0:7477:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1783969299.361244:0:7477:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1783969299.361769:0:7477:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1783969299.363003:0:7477:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1783969299.577039:0:7477:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1783969299.577046:0:7477:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1783969299.577076:0:7477:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783969299.577133:0:7477:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.139@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783969299.577218:0:7477:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1783969299.577245:0:7477:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1783969300.005012:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969301.029005:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969302.052963:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969303.076997:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969303.142433:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280537728:0@lo:13: 00000100:00100000:0.0:1783969303.142504:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969303.142571:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280537728 00000100:00100000:0.0:1783969303.142579:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280537728 00000100:00080000:3.0:1783969303.142620:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783969303.142635:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783969303.142645:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280537728:12345-0@lo:13: 00002000:00000024:0.0:1783969303.142677:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783969303.142728:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280537728:12345-0@lo:13: Request processed in 84us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969303.142735:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1783969303.143935:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac798164e00 x1870627280537728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969303.143960:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798164e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280537728:0@lo:13: 00010000:00010000:1.0:1783969304.104129:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969304.677289:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280537856:0@lo:400: 00000100:00100000:2.0:1783969304.677362:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969304.677406:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1870627280538368:0@lo:400: 00000100:00100000:2.0:1783969304.677436:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969304.677461:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783969304.677476:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280537984:0@lo:400: 00000100:00100000:2.0:1783969304.677514:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969304.677542:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280538112:0@lo:400: 00000100:00100000:2.0:1783969304.677566:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969304.677584:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783969304.677589:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280538240:0@lo:400: 00000100:00100000:2.0:1783969304.677613:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969304.677647:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280537856 00000100:00100000:3.0:1783969304.677648:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280538240 00000100:00100000:3.0:1783969304.677654:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280538240 00000100:00100000:2.0:1783969304.677654:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280537856 00000100:00100000:3.0:1783969304.677694:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783969304.677694:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783969304.677702:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280538240:12345-0@lo:400: 00000100:00100000:2.0:1783969304.677702:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+13:3287:x1870627280537856:12345-0@lo:400: 00000100:00100000:3.0:1783969304.677747:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280538240:12345-0@lo:400: Request processed in 44us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969304.677747:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+13:3287:x1870627280537856:12345-0@lo:400: Request processed in 44us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969304.677755:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783969304.677755:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783969304.678371:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280538368 00000100:00100000:2.0:1783969304.678377:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280538368 00000100:00100000:0.0:1783969304.678620:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280537984 00000100:00100000:0.0:1783969304.678624:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280537984 00000100:00100000:0.0:1783969304.678643:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280538112 00000100:00100000:0.0:1783969304.678645:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280538112 00000100:00100000:0.0:1783969304.678671:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783969304.678677:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1870627280538368:12345-0@lo:400: 00000100:00100000:0.0:1783969304.678723:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1870627280538368:12345-0@lo:400: Request processed in 46us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969304.678729:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783969304.678743:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783969304.678749:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280537984:12345-0@lo:400: 00000100:00080000:3.0:1783969304.678768:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969304.678777:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280537984:12345-0@lo:400: Request processed in 29us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969304.678853:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783969304.678935:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783969304.678942:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280538112:12345-0@lo:400: 00000100:00100000:0.0:1783969304.678972:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280538112:12345-0@lo:400: Request processed in 31us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969304.678978:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1783969304.681627:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7ba611500 x1870627280538240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969304.681645:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280538240:0@lo:400: 00010000:00080000:3.0:1783969304.681658:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7ba611180 x1870627280538112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969304.681667:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280538112:0@lo:400: 00010000:00080000:3.0:1783969304.681721:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7ba610e00 x1870627280537984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969304.681741:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280537984:0@lo:400: 00000100:00100000:3.0:1783969304.681754:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280537856:0@lo:400: 00010000:00080000:3.0:1783969304.681766:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7ba612300 x1870627280538368/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969304.681774:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1870627280538368:0@lo:400: 00010000:00010000:0.0:1783969305.126547:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783969305.993293:0:7833:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783969306.149977:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969307.177673:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969308.197392:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969308.261083:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969308.261110:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280538496:0@lo:13: 00000100:00100000:3.0:1783969308.261176:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969308.261307:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280538496 00000100:00100000:0.0:1783969308.261315:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280538496 00000100:00100000:0.0:1783969308.261376:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783969308.261385:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785314e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280538496:12345-0@lo:13: 00002000:00000024:0.0:1783969308.261417:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783969308.261480:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785314e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280538496:12345-0@lo:13: Request processed in 97us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969308.261487:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1783969308.261737:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783969308.261751:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac798164000 x1870627280538496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969308.261770:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280538496:0@lo:13: 10000000:01000000:0.0:1783969308.772982:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783969308.772991:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ac7ba5f7000 from 30 10000000:01000000:0.0:1783969308.773013:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783969308.773056:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac780031200/0xbacf56d076faac6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969308.773068:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac780031200/0xbacf56d076faac6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969308.773079:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac780031200/0xbacf56d076faac6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969308.773103:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280538624:0@lo:101: 00000100:00100000:0.0:1783969308.773170:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969308.773238:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7860b0600 going to sleep for 11 seconds 00000100:00100000:2.0:1783969308.773387:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280538624 00000100:00100000:2.0:1783969308.773404:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280538624 00000100:00100000:2.0:1783969308.773461:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783969308.773470:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+13:5790:x1870627280538624:12345-0@lo:101: 00010000:00010000:2.0:1783969308.773482:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969308.773495:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7c21e3c00/0xbacf56d076faac76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faac6f expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969308.773516:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7c21e3c00/0xbacf56d076faac76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faac6f expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969308.773526:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7c21e3c00/0xbacf56d076faac76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faac6f expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969308.773535:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c21e3c00, rc 0) 00000100:00100000:2.0:1783969308.773580:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+14:5790:x1870627280538624:12345-0@lo:101: Request processed in 111us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969308.773586:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783969308.773773:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280538624:0@lo:101: 00010000:00010000:0.0:1783969308.773800:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac780031200/0xbacf56d076faac6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faac76 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969308.773808:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac780031200/0xbacf56d076faac6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faac76 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969308.773854:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280538752:0@lo:501: 00000100:00100000:0.0:1783969308.773898:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969308.773921:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7860b0600 going to sleep for 11 seconds 00000100:00100000:3.0:1783969308.779806:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280538752 00000100:00100000:3.0:1783969308.779822:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280538752 00000100:00100000:3.0:1783969308.779927:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783969308.779938:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+14:5790:x1870627280538752:12345-0@lo:501: 00000100:00100000:3.0:1783969308.780352:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+14:5790:x1870627280538752:12345-0@lo:501: Request processed in 414us (6450us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969308.780361:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783969308.781175:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280538752:0@lo:501: 00000100:00100000:0.0:1783969308.781231:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280538880:0@lo:503: 00000100:00100000:0.0:1783969308.781300:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969308.781336:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7860b0600 going to sleep for 11 seconds 00000100:00100000:1.0:1783969308.781561:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280538880 00000100:00100000:1.0:1783969308.781574:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280538880 00000100:00100000:1.0:1783969308.781624:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783969308.781632:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+14:5790:x1870627280538880:12345-0@lo:503: 00000100:00100000:1.0:1783969308.782008:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+14:5790:x1870627280538880:12345-0@lo:503: Request processed in 375us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969308.782015:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783969308.782186:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280538880:0@lo:503: 00000100:00100000:3.0:1783969308.791598:0:7937:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785317800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:7937:1870627280539008:0@lo:502: 00000100:00100000:3.0:1783969308.791689:0:7937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969308.791734:0:7937:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7851a4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969308.791792:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280539008 00000100:00100000:1.0:1783969308.791799:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280539008 00000100:00100000:1.0:1783969308.791842:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783969308.791850:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+14:7937:x1870627280539008:12345-0@lo:502: 00000100:00100000:1.0:1783969308.792167:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+14:7937:x1870627280539008:12345-0@lo:502: Request processed in 317us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969308.792175:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783969308.794154:0:7937:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785317800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:7937:1870627280539008:0@lo:502: 00000100:00100000:3.0:1783969308.794234:0:7937:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785317800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:7937:1870627280539136:0@lo:502: 00000100:00100000:3.0:1783969308.794319:0:7937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969308.794361:0:7937:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac786038900 going to sleep for 11 seconds 00000100:00100000:1.0:1783969308.794547:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280539136 00000100:00100000:1.0:1783969308.794554:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280539136 00000100:00100000:1.0:1783969308.794608:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783969308.794617:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+14:7937:x1870627280539136:12345-0@lo:502: 00000100:00100000:1.0:1783969308.794907:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+14:7937:x1870627280539136:12345-0@lo:502: Request processed in 290us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969308.794915:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783969308.795236:0:7937:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785317800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:7937:1870627280539136:0@lo:502: 00000040:00080000:3.0:1783969308.795282:0:7937:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1783969308.795650:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1783969308.795670:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783969308.795680:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac780031200/0xbacf56d076faac6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faac76 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969308.795691:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac780031200/0xbacf56d076faac6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faac76 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969308.795712:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1783969308.795715:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1783969308.795718:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783969308.795748:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faac7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969308.795757:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faac7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969308.795766:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faac7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969308.795797:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280539264:0@lo:101: 00000100:00100000:1.0:1783969308.795842:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969308.795913:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7838636c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969308.795968:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280539264 00000100:00100000:3.0:1783969308.795974:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280539264 00000100:00100000:3.0:1783969308.796014:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783969308.796022:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+14:5790:x1870627280539264:12345-0@lo:101: 00010000:00010000:3.0:1783969308.796033:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969308.796045:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac783de7800/0xbacf56d076faac84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faac7d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969308.796078:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac783de7800/0xbacf56d076faac84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faac7d expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969308.796089:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac783de7800/0xbacf56d076faac84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faac7d expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969308.796097:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7800, rc 0) 00000100:00100000:3.0:1783969308.796137:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+15:5790:x1870627280539264:12345-0@lo:101: Request processed in 116us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969308.796143:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783969308.796363:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280539264:0@lo:101: 00010000:00010000:1.0:1783969308.796376:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faac7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faac84 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969308.796384:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faac7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faac84 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969308.796443:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280539392:0@lo:501: 00000100:00100000:1.0:1783969308.796471:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969308.796495:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7838636c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969308.796591:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280539392 00000100:00100000:3.0:1783969308.796595:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280539392 00000100:00100000:3.0:1783969308.796631:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783969308.796639:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+15:5790:x1870627280539392:12345-0@lo:501: 00000100:00100000:3.0:1783969308.796928:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+15:5790:x1870627280539392:12345-0@lo:501: Request processed in 289us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969308.796934:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783969308.798118:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280539392:0@lo:501: 00000100:00100000:1.0:1783969308.798169:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280539520:0@lo:503: 00000100:00100000:1.0:1783969308.798237:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969308.798287:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7838636c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969308.800374:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280539520 00000100:00100000:3.0:1783969308.800388:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280539520 00000100:00100000:3.0:1783969308.800469:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783969308.800480:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+15:5790:x1870627280539520:12345-0@lo:503: 00000100:00100000:3.0:1783969308.801129:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+15:5790:x1870627280539520:12345-0@lo:503: Request processed in 650us (2890us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969308.801138:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783969308.803041:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280539520:0@lo:503: 00000100:00100000:0.0:1783969308.803580:0:7939:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a82d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:7939:1870627280539648:0@lo:502: 00000100:00100000:0.0:1783969308.803655:0:7939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969308.803694:0:7939:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7860b0780 going to sleep for 11 seconds 00000100:00100000:1.0:1783969308.803760:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280539648 00000100:00100000:1.0:1783969308.803766:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280539648 00000100:00100000:1.0:1783969308.803824:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783969308.803833:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+15:7939:x1870627280539648:12345-0@lo:502: 00000100:00100000:1.0:1783969308.804131:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+15:7939:x1870627280539648:12345-0@lo:502: Request processed in 287us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969308.804138:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783969308.804403:0:7939:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a82d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:7939:1870627280539648:0@lo:502: 00000020:01000000:0.0:1783969308.804430:0:7939:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969308.804438:0:7939:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969308.804440:0:7939:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783969308.804445:0:7939:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783969308.804447:0:7939:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1783969308.804467:0:7939:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a82d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:7939:1870627280539776:0@lo:502: 00000100:00100000:0.0:1783969308.804505:0:7939:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969308.804538:0:7939:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7860b0780 going to sleep for 11 seconds 00000100:00100000:1.0:1783969308.804579:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280539776 00000100:00100000:1.0:1783969308.804584:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280539776 00000100:00100000:1.0:1783969308.804614:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783969308.804621:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+15:7939:x1870627280539776:12345-0@lo:502: 00000100:00100000:1.0:1783969308.804796:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+15:7939:x1870627280539776:12345-0@lo:502: Request processed in 174us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969308.804804:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783969308.809148:0:7939:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a82d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:7939:1870627280539776:0@lo:502: 00000020:01000000:2.0:1783969308.809193:0:7939:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783969308.809211:0:7939:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969308.809214:0:7939:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783969308.809219:0:7939:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1783969308.811828:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1783969308.811854:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783969308.811934:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faac7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faac84 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969308.811945:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faac7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faac84 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969308.811955:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783969308.811957:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ac783021000 from 30 10000000:01000000:1.0:1783969308.811960:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783969308.812002:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faac8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969308.812010:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faac8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969308.812019:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faac8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969308.812040:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280539904:0@lo:101: 00000100:00100000:1.0:1783969308.812100:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969308.813290:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba11be40 going to sleep for 11 seconds 00000100:00100000:3.0:1783969308.815213:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280539904 00000100:00100000:3.0:1783969308.815227:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280539904 00000100:00100000:3.0:1783969308.815280:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783969308.815289:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+15:5790:x1870627280539904:12345-0@lo:101: 00010000:00010000:3.0:1783969308.815305:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969308.815335:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac783de7200/0xbacf56d076faac92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faac8b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969308.815361:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac783de7200/0xbacf56d076faac92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faac8b expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969308.815371:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac783de7200/0xbacf56d076faac92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faac8b expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969308.815379:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7200, rc 0) 00000100:00100000:3.0:1783969308.815446:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+16:5790:x1870627280539904:12345-0@lo:101: Request processed in 158us (3344us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969308.815453:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783969308.817061:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280539904:0@lo:101: 00010000:00010000:1.0:1783969308.817085:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faac8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faac92 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969308.817096:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faac8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faac92 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969308.818536:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280540032:0@lo:501: 00000100:00100000:1.0:1783969308.818599:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969308.819604:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba11be40 going to sleep for 11 seconds 00000100:00100000:0.0:1783969308.831697:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280540032 00000100:00100000:0.0:1783969308.831713:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280540032 00000100:00100000:0.0:1783969308.831786:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783969308.831797:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+16:5790:x1870627280540032:12345-0@lo:501: 00000100:00100000:0.0:1783969308.832115:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+16:5790:x1870627280540032:12345-0@lo:501: Request processed in 320us (13515us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969308.832136:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783969308.833900:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280540032:0@lo:501: 00000100:00100000:1.0:1783969308.833957:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280540160:0@lo:503: 00000100:00100000:1.0:1783969308.834019:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969308.834063:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba11be40 going to sleep for 11 seconds 00000100:00100000:0.0:1783969308.835379:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280540160 00000100:00100000:0.0:1783969308.835389:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280540160 00000100:00100000:0.0:1783969308.835454:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783969308.835465:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+16:5790:x1870627280540160:12345-0@lo:503: 00000100:00100000:0.0:1783969308.835688:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+16:5790:x1870627280540160:12345-0@lo:503: Request processed in 225us (1668us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969308.835696:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783969308.835749:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280540160:0@lo:503: 00000100:00100000:1.0:1783969308.842166:0:7942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:7942:1870627280540288:0@lo:502: 00000100:00100000:1.0:1783969308.842319:0:7942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969308.842404:0:7942:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba11b540 going to sleep for 11 seconds 00000100:00100000:0.0:1783969308.847339:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280540288 00000100:00100000:0.0:1783969308.847366:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280540288 00000100:00100000:0.0:1783969308.847424:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1783969308.847553:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+16:7942:x1870627280540288:12345-0@lo:502: 00000100:00100000:0.0:1783969308.848292:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+16:7942:x1870627280540288:12345-0@lo:502: Request processed in 859us (5972us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969308.848301:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783969308.848597:0:7942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:7942:1870627280540288:0@lo:502: 00000100:00100000:1.0:1783969308.848755:0:7942:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:7942:1870627280540416:0@lo:502: 00000100:00100000:1.0:1783969308.848810:0:7942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969308.848838:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280540416 00000100:00100000:1.0:1783969308.848844:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280540416 00000100:00100000:1.0:1783969308.848889:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783969308.848896:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+16:7942:x1870627280540416:12345-0@lo:502: 00000100:00100000:1.0:1783969308.849064:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+16:7942:x1870627280540416:12345-0@lo:502: Request processed in 167us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969308.849070:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783969308.849110:0:7942:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba11b540 going to sleep for 11 seconds 00000100:00100000:1.0:1783969308.849123:0:7942:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:7942:1870627280540416:0@lo:502: 00000040:00080000:1.0:1783969308.849144:0:7942:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1783969308.850924:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1783969308.850952:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783969308.850963:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faac8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faac92 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969308.850974:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faac8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faac92 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969308.850983:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783969308.850985:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ac783021000 from 5 10000000:01000000:0.0:1783969308.850988:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783969308.851022:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac780030400/0xbacf56d076faac99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969308.851029:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac780030400/0xbacf56d076faac99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969308.851039:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac780030400/0xbacf56d076faac99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969308.851058:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280540544:0@lo:101: 00000100:00100000:0.0:1783969308.851112:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969308.851533:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7860b0780 going to sleep for 11 seconds 00000100:00100000:1.0:1783969308.851713:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280540544 00000100:00100000:1.0:1783969308.851721:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280540544 00000100:00100000:1.0:1783969308.851788:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783969308.851798:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+16:5790:x1870627280540544:12345-0@lo:101: 00010000:00010000:1.0:1783969308.851811:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969308.851828:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac781496e00/0xbacf56d076faaca0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faac99 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969308.851852:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac781496e00/0xbacf56d076faaca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faac99 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969308.851880:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac781496e00/0xbacf56d076faaca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faac99 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969308.851903:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac781496e00, rc 0) 00000100:00100000:1.0:1783969308.851957:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280540544:12345-0@lo:101: Request processed in 160us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969308.851964:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783969308.852006:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280540544:0@lo:101: 00010000:00010000:1.0:1783969308.852020:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac780030400/0xbacf56d076faac99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaca0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969308.852031:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac780030400/0xbacf56d076faac99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faaca0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969308.852082:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280540672:0@lo:256: 00000100:00100000:1.0:1783969308.852114:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969308.852610:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba11b000 going to sleep for 11 seconds 00000100:00100000:0.0:1783969308.852822:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280540672 00000100:00100000:0.0:1783969308.852835:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280540672 00000100:00100000:0.0:1783969308.852879:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783969308.852887:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280540672:12345-0@lo:256: 20000000:01000000:0.0:1783969308.852903:0:5788:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783969308.852919:0:5788:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783969308.852922:0:5788:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1783969308.853004:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280540672:12345-0@lo:256: Request processed in 117us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969308.853011:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783969308.853094:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280540672:0@lo:256: 10000000:01000000:1.0:1783969308.853360:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783969308.853369:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac780030400/0xbacf56d076faac99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaca0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969308.853378:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac780030400/0xbacf56d076faac99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaca0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969308.853387:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1783969308.853389:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1783969308.853391:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783969308.853467:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781496a00/0xbacf56d076faaca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969308.853481:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac781496a00/0xbacf56d076faaca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969308.853491:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac781496a00/0xbacf56d076faaca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969308.853506:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280540800:0@lo:101: 00000100:00100000:1.0:1783969308.853536:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969308.853600:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba11b000 going to sleep for 11 seconds 00000100:00100000:0.0:1783969308.853635:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280540800 00000100:00100000:0.0:1783969308.853639:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280540800 00000100:00100000:0.0:1783969308.853699:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783969308.853706:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280540800:12345-0@lo:101: 00010000:00010000:0.0:1783969308.853715:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969308.853726:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac780031400/0xbacf56d076faacae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faaca7 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969308.853743:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac780031400/0xbacf56d076faacae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faaca7 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969308.853752:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac780031400/0xbacf56d076faacae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faaca7 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969308.853760:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac780031400, rc 0) 00000100:00100000:0.0:1783969308.853802:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280540800:12345-0@lo:101: Request processed in 97us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969308.853808:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783969308.853990:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280540800:0@lo:101: 00010000:00010000:1.0:1783969308.854003:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac781496a00/0xbacf56d076faaca7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faacae expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969308.854012:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac781496a00/0xbacf56d076faaca7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faacae expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969308.854057:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280540928:0@lo:501: 00000100:00100000:1.0:1783969308.854082:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969308.854101:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba11b000 going to sleep for 11 seconds 00000100:00100000:1.0:1783969308.854112:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280540928 00000100:00100000:1.0:1783969308.854116:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280540928 00000100:00100000:1.0:1783969308.854294:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783969308.854301:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280540928:12345-0@lo:501: 00000100:00100000:1.0:1783969308.854545:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280540928:12345-0@lo:501: Request processed in 243us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969308.854552:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783969308.854591:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280540928:0@lo:501: 00000100:00100000:1.0:1783969308.854618:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280541056:0@lo:503: 00000100:00100000:1.0:1783969308.854652:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969308.854665:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba11b000 going to sleep for 11 seconds 00000100:00100000:1.0:1783969308.854675:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280541056 00000100:00100000:1.0:1783969308.854678:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280541056 00000100:00100000:1.0:1783969308.854697:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783969308.854702:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280541056:12345-0@lo:503: 00000100:00100000:1.0:1783969308.855103:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280541056:12345-0@lo:503: Request processed in 399us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969308.855110:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783969308.855310:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280541056:0@lo:503: 00000100:00100000:1.0:1783969308.855757:0:7944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:7944:1870627280541184:0@lo:502: 00000100:00100000:1.0:1783969308.855808:0:7944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969308.855879:0:7944:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba11bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783969308.855919:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280541184 00000100:00100000:0.0:1783969308.855924:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280541184 00000100:00100000:0.0:1783969308.855987:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783969308.855994:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+18:7944:x1870627280541184:12345-0@lo:502: 00000100:00100000:0.0:1783969308.856565:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+18:7944:x1870627280541184:12345-0@lo:502: Request processed in 569us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969308.856572:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783969308.856631:0:7944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:7944:1870627280541184:0@lo:502: 00000020:01000000:1.0:1783969308.856657:0:7944:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783969308.856664:0:7944:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1783969308.856670:0:7944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969308.856672:0:7944:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783969308.856677:0:7944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783969308.856680:0:7944:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.139@tcp to nid 0x20000c0a8cb8b (192.168.203.139@tcp) 00000020:01000000:1.0:1783969308.856699:0:7944:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783969308.856702:0:7944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783969308.856716:0:7944:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ac7b64319c0) 00000020:00000080:1.0:1783969308.856736:0:7944:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1783969308.856747:0:7944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783969308.856827:0:7944:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783969308.856832:0:7944:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1783969308.856838:0:7944:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbacf56d076faacbc 00010000:00080000:1.0:1783969308.859453:0:7944:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ac7c19c5000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.139@tcp at head 00010000:00010000:1.0:1783969308.859682:0:7944:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1783969308.860082:0:7944:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1783969308.860095:0:7944:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783969308.864617:0:7944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783969308.866376:0:7944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783969308.866513:0:7944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1783969308.866582:0:7944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1783969308.867874:0:7946:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783969308.867880:0:7946:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1783969308.868504:0:7944:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783969308.868518:0:7944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783969308.868551:0:7944:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783969308.868572:0:7944:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbacf56d076faacc3 00000100:00080000:1.0:1783969308.868582:0:7944:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783969308.868589:0:7944:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ac7c19c5000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1783969308.868621:0:7944:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac798166d80 x1870627280541312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783969308.868663:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1870627280541312:0@lo:8: 00000100:00080000:1.0:1783969308.868727:0:7944:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1783969308.868730:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1783969308.868771:0:7944:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969308.868786:0:7944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969308.868788:0:7944:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000100:00100000:2.0:1783969308.868792:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280541312 00000020:01000000:1.0:1783969308.868792:0:7944:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969308.868796:0:7944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969308.868797:0:7944:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783969308.868801:0:7944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783969308.868802:0:7944:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783969308.868805:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280541312 00000100:00100000:1.0:1783969308.868826:0:7944:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798164000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:7944:1870627280541440:0@lo:502: 00000100:00100000:2.0:1783969308.868835:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783969308.868843:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3284:x1870627280541312:12345-0@lo:8: 00010000:00080000:2.0:1783969308.868884:0:6593:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 165 last 0 00000100:00100000:1.0:1783969308.868884:0:7944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969308.868909:0:7944:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba11be40 going to sleep for 11 seconds 00000020:00000080:2.0:1783969308.868912:0:6593:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbacf56d076faacca 00002000:00100000:2.0:1783969308.868924:0:6593:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ac7ba65b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1783969308.868929:0:6593:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1783969308.868933:0:6593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1783969308.868995:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280541440 00000100:00100000:0.0:1783969308.869000:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280541440 00000100:00100000:0.0:1783969308.869028:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00002000:00100000:2.0:1783969308.869031:0:6593:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1783969308.869034:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+18:7944:x1870627280541440:12345-0@lo:502: 00000100:00100000:0.0:1783969308.869385:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+18:7944:x1870627280541440:12345-0@lo:502: Request processed in 350us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969308.869393:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783969308.869564:0:7944:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798164000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:7944:1870627280541440:0@lo:502: 00000020:01000000:1.0:1783969308.869589:0:7944:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969308.869593:0:7944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969308.869595:0:7944:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783969308.869599:0:7944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1783969308.869737:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1783969308.869754:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783969308.869763:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781496a00/0xbacf56d076faaca7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faacae expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969308.869773:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac781496a00/0xbacf56d076faaca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faacae expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969308.869793:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783969308.869796:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9ac7917f19c0 from 1 10000000:01000000:0.0:1783969308.869798:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783969308.869820:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac780031000/0xbacf56d076faacd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969308.869828:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac780031000/0xbacf56d076faacd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969308.869848:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac780031000/0xbacf56d076faacd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969308.870015:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280541568:0@lo:101: 00000100:00100000:0.0:1783969308.870049:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969308.870114:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b5013540 going to sleep for 11 seconds 00000100:00100000:0.0:1783969308.872062:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1870627280541696:0@lo:400: 00000100:00100000:0.0:1783969308.872136:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969308.872172:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783969308.872178:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280541824:0@lo:400: 00000100:00100000:0.0:1783969308.872616:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969308.872655:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1870627280541952:0@lo:400: 00000100:00100000:0.0:1783969308.872703:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969308.872741:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280541696 00000100:00100000:0.0:1783969308.872748:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280541696 00000100:00100000:0.0:1783969308.872797:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280541824 00000100:00100000:0.0:1783969308.872799:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280541824 00000100:00100000:0.0:1783969308.872817:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280541952 00000100:00100000:0.0:1783969308.872819:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280541952 00000100:00100000:0.0:1783969308.872832:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783969308.872839:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1870627280541696:12345-0@lo:400: 00000100:00100000:0.0:1783969308.872902:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1870627280541696:12345-0@lo:400: Request processed in 63us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969308.872909:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783969308.872923:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783969308.872928:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280541824:12345-0@lo:400: 00000100:00100000:0.0:1783969308.872959:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280541824:12345-0@lo:400: Request processed in 31us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969308.872964:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783969308.872974:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783969308.872978:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1870627280541952:12345-0@lo:400: 00000100:00100000:0.0:1783969308.872999:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1870627280541952:12345-0@lo:400: Request processed in 21us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969308.873005:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1783969308.873026:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783969308.873047:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7a7a81500 x1870627280541952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969308.873059:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1870627280541952:0@lo:400: 00010000:00080000:0.0:1783969308.873079:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7a7a81880 x1870627280541824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969308.873088:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280541824:0@lo:400: 00010000:00080000:0.0:1783969308.873096:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7a7a83800 x1870627280541696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969308.873103:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1870627280541696:0@lo:400: 00000100:00100000:1.0:1783969308.873813:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280541568 00000100:00100000:1.0:1783969308.873820:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280541568 00000100:00100000:0.0:1783969308.875274:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783969308.875285:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280541568:12345-0@lo:101: 00010000:00010000:0.0:1783969308.875302:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969308.875336:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7bfb93e00/0xbacf56d076faacd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faacd1 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969308.875368:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7bfb93e00/0xbacf56d076faacd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faacd1 expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969308.875388:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7bfb93e00/0xbacf56d076faacd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faacd1 expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969308.875397:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93e00, rc 0) 00002000:00080000:2.0:1783969308.875460:0:6593:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783969308.875488:0:6593:0:(import.c:65:import_set_state_nolock()) ffff9ac7ba65a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783969308.875615:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3284:x1870627280541312:12345-0@lo:8: Request processed in 6771us (6884us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969308.875624:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1783969308.875664:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac798166d80 x1870627280541312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783969318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969308.875674:0:3284:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783969308.875681:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783969308.875689:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783969308.875693:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1783969308.875696:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9ac7c19c5000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783969308.875703:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+19:5790:x1870627280541568:12345-0@lo:101: Request processed in 416us (5649us total) trans 0 rc 0/0 00000004:00080000:2.0:1783969308.875710:0:3284:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783969308.875711:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783969308.875718:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798166d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1870627280541312:0@lo:8: 00000004:00080000:2.0:1783969308.875757:0:7946:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1783969308.875765:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a80000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280541568:0@lo:101: 00010000:00010000:0.0:1783969308.875793:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac780031000/0xbacf56d076faacd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faacd8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969308.875805:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac780031000/0xbacf56d076faacd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faacd8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969308.875887:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7ae8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280542080:0@lo:501: 00000004:00080000:2.0:1783969308.875892:0:7946:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 165958031862ns, next at 0ns, rc = 0 00000100:00100000:0.0:1783969308.875928:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969308.875966:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b5013540 going to sleep for 11 seconds 00000100:00100000:2.0:1783969308.876684:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280542080 00000100:00100000:2.0:1783969308.876691:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280542080 00000100:00100000:2.0:1783969308.876725:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783969308.876731:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:5790:x1870627280542080:12345-0@lo:501: 00000100:00100000:2.0:1783969308.876972:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:5790:x1870627280542080:12345-0@lo:501: Request processed in 239us (1045us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783969308.876979:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783969308.877031:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7ae8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280542080:0@lo:501: 10000000:01000000:0.0:1783969308.877055:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783969308.877064:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac780031000/0xbacf56d076faacd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faacd8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969308.877073:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac780031000/0xbacf56d076faacd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faacd8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783969308.976640:0:7947:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1783969308.976675:0:7947:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798164e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7947:1870627280542336:0@lo:7: 00000100:00100000:1.0:1783969308.976745:0:7947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969308.976802:0:7947:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba11b600 going to sleep for 11 seconds 00000100:00100000:3.0:1783969308.977226:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280542336 00000100:00100000:3.0:1783969308.977234:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280542336 00000100:00100000:3.0:1783969308.977287:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783969308.977298:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798165500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7947:x1870627280542336:12345-0@lo:7: 00000100:00080000:1.0:1783969308.977570:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969308.978888:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280542208:0@lo:13: 00000100:00100000:1.0:1783969308.978959:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969308.979527:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280542208 00000100:00100000:0.0:1783969308.979540:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280542208 00000100:00100000:0.0:1783969308.979578:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783969308.979584:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1870627280542208:12345-0@lo:13: 00002000:00000024:0.0:1783969308.979614:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1783969308.979660:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798164a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1870627280542208:12345-0@lo:13: Request processed in 75us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969308.979666:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1783969308.979706:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac798164000 x1870627280542208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969308.979724:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798164000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280542208:0@lo:13: 00002000:00080000:3.0:1783969308.994577:0:6594:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1783969308.994592:0:6594:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1783969308.994697:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798165500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7947:x1870627280542336:12345-0@lo:7: Request processed in 17396us (17947us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969308.994707:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1783969309.002693:0:7947:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac798164e00 x1870627280542336/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783969324 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969309.002712:0:7947:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798164e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7947:1870627280542336:0@lo:7: 00000004:00080000:1.0:1783969309.002727:0:7947:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1783969309.002769:0:7947:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798164e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7947:1870627280542464:0@lo:5: 00000100:00100000:1.0:1783969309.002838:0:7947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969309.002907:0:7947:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba11b600 going to sleep for 11 seconds 00000004:00080000:1.0:1783969309.002922:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1783969309.004660:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280542464 00000100:00100000:3.0:1783969309.004673:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280542464 00000100:00100000:3.0:1783969309.004734:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783969309.004743:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7947:x1870627280542464:12345-0@lo:5: 00002000:00080000:3.0:1783969309.004786:0:6593:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1783969309.004789:0:6593:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1783969309.005109:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7947:x1870627280542464:12345-0@lo:5: Request processed in 366us (2269us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1783969309.005116:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1783969309.005487:0:7947:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac798164e00 x1870627280542464/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783969325 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969309.005504:0:7947:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798164e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7947:1870627280542464:0@lo:5: 00000004:00080000:1.0:1783969309.005516:0:7947:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1783969309.005889:0:7947:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798166a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7947:1870627280542592:0@lo:700: 00000100:00100000:1.0:1783969309.005930:0:7947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969309.005960:0:7947:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba11b600 going to sleep for 11 seconds 00000100:00100000:3.0:1783969309.006453:0:6601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280542592 00000100:00100000:3.0:1783969309.006459:0:6601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280542592 00000100:00100000:3.0:1783969309.006500:0:6601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783969309.006508:0:6601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7947:x1870627280542592:12345-0@lo:700: 00000100:00100000:3.0:1783969309.007893:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785317800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6601:1870627280542720:0@lo:700: 00000100:00100000:3.0:1783969309.007955:0:6601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969309.007995:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa2dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969309.008086:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280542720 00000100:00100000:1.0:1783969309.008092:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280542720 00000100:00100000:1.0:1783969309.008141:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783969309.008150:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6601:x1870627280542720:12345-0@lo:700: 40000000:02000000:1.0:1783969309.088925:0:5800:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1783969309.099358:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6601:x1870627280542720:12345-0@lo:700: Request processed in 91200us (91393us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969309.099374:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783969309.099449:0:6601:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac785317800 x1870627280542720/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783969325 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969309.099465:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785317800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6601:1870627280542720:0@lo:700: 40000000:02000000:3.0:1783969309.099478:0:6601:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:1.0:1783969309.217413:0:7494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1783969309.217429:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1783969309.217641:0:6601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798165c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7947:x1870627280542592:12345-0@lo:700: Request processed in 211130us (211706us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969309.217657:0:6601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783969309.218497:0:7947:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac798166a00 x1870627280542592/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783969325 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969309.218510:0:7947:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1783969309.218526:0:7947:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798166a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7947:1870627280542592:0@lo:700: 00010000:00010000:0.0:1783969309.232994:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:1.0:1783969309.246066:0:7947:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1783969309.256087:0:7947:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7947:1870627280542848:0@lo:5: 00000100:00100000:2.0:1783969309.256150:0:7947:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969309.256202:0:7947:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfda6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969309.256259:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280542848 00000100:00100000:0.0:1783969309.256266:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280542848 00000100:00100000:0.0:1783969309.256317:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783969309.256326:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7947:x1870627280542848:12345-0@lo:5: 00002000:00080000:1.0:1783969309.265824:0:6594:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1783969309.265845:0:6594:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1783969309.277626:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7947:x1870627280542848:12345-0@lo:5: Request processed in 21291us (21466us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1783969309.277640:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1783969309.279276:0:7947:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac681f4c700 x1870627280542848/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783969325 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969309.279294:0:7947:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7947:1870627280542848:0@lo:5: 00000004:00080000:1.0:1783969309.279309:0:7947:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1783969310.246004:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783969310.964053:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1783969311.270034:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969311.499417:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969311.499499:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272130688 00000100:00100000:2.0:1783969311.499508:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272130688 00000100:00100000:2.0:1783969311.499552:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 111 00000100:00100000:2.0:1783969311.499560:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2347:x1870627272130688:12345-192.168.203.39@tcp:250: 00010000:00080000:2.0:1783969311.499585:0:5786:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from f76c8f1a-030e-4d3a-84d5-8ee5d8211d03@192.168.203.39@tcp t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:2.0:1783969311.499609:0:5786:0:(genops.c:1406:class_connect()) connect: client f76c8f1a-030e-4d3a-84d5-8ee5d8211d03, cookie 0xbacf56d076faacdf 00000100:00080000:2.0:1783969311.499976:0:5786:0:(import.c:65:import_set_state_nolock()) ffff9ac7ba65d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783969311.500047:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+5:2347:x1870627272130688:12345-192.168.203.39@tcp:250: Request processed in 486us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969311.500056:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 111 00000100:00100000:1.0:1783969311.507146:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969311.507361:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272130816 00000100:00100000:1.0:1783969311.507370:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272130816 00000100:00100000:1.0:1783969311.507424:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 112 00000100:00100000:1.0:1783969311.507434:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+5:5567:x1870627272130816:12345-192.168.203.39@tcp:101: 00010000:00010000:1.0:1783969311.507451:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969311.507469:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac781497200/0xbacf56d076faace6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb62fcf expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969311.507499:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac781497200/0xbacf56d076faace6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb62fcf expref: 6 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969311.507511:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac781497200/0xbacf56d076faace6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb62fcf expref: 6 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969311.507521:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac781497200, rc 0) 00000100:00100000:1.0:1783969311.507575:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+6:5567:x1870627272130816:12345-192.168.203.39@tcp:101: Request processed in 142us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969311.507581:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 112 00000100:00100000:1.0:1783969311.512557:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969311.514222:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272130944 00000100:00100000:0.0:1783969311.514235:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272130944 00000100:00100000:0.0:1783969311.514301:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 113 00000100:00100000:0.0:1783969311.514311:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+6:5567:x1870627272130944:12345-192.168.203.39@tcp:501: 00000100:00100000:0.0:1783969311.514671:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+6:5567:x1870627272130944:12345-192.168.203.39@tcp:501: Request processed in 360us (2121us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783969311.514679:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 113 00000100:00100000:1.0:1783969311.519725:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969311.520290:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272131072 00000100:00100000:3.0:1783969311.520300:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272131072 00000100:00100000:3.0:1783969311.520372:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 114 00000100:00100000:3.0:1783969311.520382:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+6:5567:x1870627272131072:12345-192.168.203.39@tcp:101: 00010000:00010000:3.0:1783969311.520398:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969311.520416:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac783de6000/0xbacf56d076faaced lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb62fd6 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969311.520443:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac783de6000/0xbacf56d076faaced lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb62fd6 expref: 7 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969311.520454:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac783de6000/0xbacf56d076faaced lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb62fd6 expref: 7 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969311.520464:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de6000, rc 0) 00000100:00100000:3.0:1783969311.520563:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+7:5567:x1870627272131072:12345-192.168.203.39@tcp:101: Request processed in 183us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969311.520571:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 114 00000100:00100000:1.0:1783969311.530797:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969311.530900:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272131200 00000100:00100000:0.0:1783969311.530910:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272131200 00000100:00100000:0.0:1783969311.531057:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 115 00000100:00100000:0.0:1783969311.531092:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+7:5567:x1870627272131200:12345-192.168.203.39@tcp:501: 00000100:00100000:0.0:1783969311.531537:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+8:5567:x1870627272131200:12345-192.168.203.39@tcp:501: Request processed in 470us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969311.531561:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 115 00000100:00100000:2.0:1783969311.538906:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969311.538946:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272131328 00000100:00100000:2.0:1783969311.538963:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272131328 00000100:00100000:2.0:1783969311.539010:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 116 00000100:00100000:2.0:1783969311.539020:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+8:5567:x1870627272131328:12345-192.168.203.39@tcp:503: 00000100:00100000:2.0:1783969311.539486:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+8:5567:x1870627272131328:12345-192.168.203.39@tcp:503: Request processed in 465us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969311.539495:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 116 00000100:00100000:1.0:1783969311.544958:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969311.545104:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272131456 00000100:00100000:3.0:1783969311.545113:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272131456 00000100:00100000:3.0:1783969311.545173:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 117 00000100:00100000:3.0:1783969311.545182:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+8:5585:x1870627272131456:12345-192.168.203.39@tcp:502: 00000100:00100000:3.0:1783969311.545509:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+8:5585:x1870627272131456:12345-192.168.203.39@tcp:502: Request processed in 326us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969311.545518:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 117 00000100:00100000:3.0:1783969311.572954:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969311.573434:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272131584 00000100:00100000:2.0:1783969311.573445:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272131584 00000100:00100000:2.0:1783969311.573487:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 118 00000100:00100000:2.0:1783969311.573496:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+8:5585:x1870627272131584:12345-192.168.203.39@tcp:502: 00000100:00100000:2.0:1783969311.573738:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+8:5585:x1870627272131584:12345-192.168.203.39@tcp:502: Request processed in 241us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969311.573746:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 118 00000100:00100000:1.0:1783969311.588019:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969311.588179:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272131712 00000100:00100000:0.0:1783969311.588188:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272131712 00000100:00100000:0.0:1783969311.588358:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 119 00000100:00100000:0.0:1783969311.588368:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+8:5567:x1870627272131712:12345-192.168.203.39@tcp:101: 00010000:00010000:0.0:1783969311.588383:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969311.588402:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7bfb92a00/0xbacf56d076faacf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63000 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969311.588429:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7bfb92a00/0xbacf56d076faacf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63000 expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969311.588441:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7bfb92a00/0xbacf56d076faacf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63000 expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969311.588450:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92a00, rc 0) 00000100:00100000:0.0:1783969311.588510:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+9:5567:x1870627272131712:12345-192.168.203.39@tcp:101: Request processed in 143us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969311.588517:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 119 00000100:00100000:1.0:1783969311.594676:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969311.597412:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272131840 00000100:00100000:2.0:1783969311.597426:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272131840 00000100:00100000:2.0:1783969311.597474:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 120 00000100:00100000:2.0:1783969311.597484:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+9:5567:x1870627272131840:12345-192.168.203.39@tcp:256: 20000000:01000000:2.0:1783969311.597510:0:5788:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1783969311.597534:0:5788:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783969311.597538:0:5788:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783969311.597542:0:5788:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783969311.597544:0:5788:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1783969311.601385:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+9:5567:x1870627272131840:12345-192.168.203.39@tcp:256: Request processed in 3891us (6708us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969311.601400:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 120 00000100:00100000:2.0:1783969311.606340:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969311.609641:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272131968 00000100:00100000:1.0:1783969311.609656:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272131968 00000100:00100000:1.0:1783969311.609817:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 121 00000100:00100000:1.0:1783969311.609829:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+9:5567:x1870627272131968:12345-192.168.203.39@tcp:101: 00010000:00010000:1.0:1783969311.609886:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969311.609906:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac781496c00/0xbacf56d076faacfb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63007 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969311.609937:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac781496c00/0xbacf56d076faacfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63007 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969311.609950:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac781496c00/0xbacf56d076faacfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63007 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969311.609960:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac781496c00, rc 0) 00000100:00100000:1.0:1783969311.610022:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:5567:x1870627272131968:12345-192.168.203.39@tcp:101: Request processed in 196us (3693us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969311.610029:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 121 00000100:00100000:3.0:1783969311.615402:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969311.615471:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272132096 00000100:00100000:2.0:1783969311.615489:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272132096 00000100:00100000:2.0:1783969311.615535:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 122 00000100:00100000:2.0:1783969311.615544:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:5567:x1870627272132096:12345-192.168.203.39@tcp:501: 00000100:00100000:2.0:1783969311.616176:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:5567:x1870627272132096:12345-192.168.203.39@tcp:501: Request processed in 631us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969311.616185:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 122 00000100:00100000:1.0:1783969311.625295:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969311.625450:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272132224 00000100:00100000:3.0:1783969311.625460:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272132224 00000100:00100000:3.0:1783969311.625516:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 123 00000100:00100000:3.0:1783969311.625541:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:5567:x1870627272132224:12345-192.168.203.39@tcp:503: 00000100:00100000:3.0:1783969311.625962:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:5567:x1870627272132224:12345-192.168.203.39@tcp:503: Request processed in 421us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969311.625972:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 123 00000100:00100000:3.0:1783969311.636604:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969311.636797:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272132352 00000100:00100000:0.0:1783969311.636807:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272132352 00000100:00100000:0.0:1783969311.636856:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 124 00000100:00100000:0.0:1783969311.636888:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:5589:x1870627272132352:12345-192.168.203.39@tcp:502: 00000100:00100000:0.0:1783969311.637176:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:5589:x1870627272132352:12345-192.168.203.39@tcp:502: Request processed in 288us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969311.637185:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 124 00000100:00100000:1.0:1783969311.645685:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969311.645773:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272132480 00000100:00100000:3.0:1783969311.645783:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272132480 00000100:00100000:3.0:1783969311.645837:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 125 00000100:00100000:3.0:1783969311.645847:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:5589:x1870627272132480:12345-192.168.203.39@tcp:502: 00000100:00100000:3.0:1783969311.646241:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:5589:x1870627272132480:12345-192.168.203.39@tcp:502: Request processed in 394us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969311.646250:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 125 00000100:00100000:1.0:1783969311.651278:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969311.651556:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272132608 00000100:00100000:3.0:1783969311.651564:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272132608 00000100:00100000:3.0:1783969311.651615:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:3.0:1783969311.651623:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2347:x1870627272132608:12345-192.168.203.39@tcp:38: 00010000:00080000:3.0:1783969311.651650:0:5794:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 03985e57-ffb4-414b-b30c-e72697857d4f@192.168.203.39@tcp t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:3.0:1783969311.651699:0:5794:0:(genops.c:1406:class_connect()) connect: client 03985e57-ffb4-414b-b30c-e72697857d4f, cookie 0xbacf56d076faad02 00000004:00100000:3.0:1783969311.651730:0:5794:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:3.0:1783969311.651737:0:5794:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1783969311.747037:0:5794:0:(import.c:65:import_set_state_nolock()) ffff9ac6827e6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783969311.747134:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798166a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+6:2347:x1870627272132608:12345-192.168.203.39@tcp:38: Request processed in 95509us (95864us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969311.747152:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:0.0:1783969312.253036:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969312.253093:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969312.253186:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272132864 00000100:00100000:1.0:1783969312.253195:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272132864 00000100:00100000:1.0:1783969312.253265:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272132736 00000100:00100000:1.0:1783969312.253269:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272132736 00000100:00100000:1.0:1783969312.253297:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:1.0:1783969312.253308:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+7:5567:x1870627272132864:12345-192.168.203.39@tcp:41: 00000004:00000024:1.0:1783969312.253352:0:5795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1783969312.253418:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+7:5567:x1870627272132864:12345-192.168.203.39@tcp:41: Request processed in 111us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969312.253425:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:1.0:1783969312.253441:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:1.0:1783969312.253462:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7ae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+6:0:x1870627272132736:12345-192.168.203.39@tcp:41: 00000004:00000024:1.0:1783969312.253474:0:5795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1783969312.253499:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7ae9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+6:0:x1870627272132736:12345-192.168.203.39@tcp:41: Request processed in 37us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969312.253505:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00080000:0.0:1783969312.253888:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969312.257362:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969312.258341:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272132992 00000100:00100000:0.0:1783969312.258353:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272132992 00000100:00100000:0.0:1783969312.258423:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:0.0:1783969312.258434:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+6:5567:x1870627272132992:12345-192.168.203.39@tcp:40: 00000100:00100000:0.0:1783969312.258524:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798164e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+6:5567:x1870627272132992:12345-192.168.203.39@tcp:40: Request processed in 91us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969312.258532:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:1.0:1783969312.264950:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969312.265194:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272133120 00000100:00100000:3.0:1783969312.265217:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272133120 00000100:00100000:3.0:1783969312.265269:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:3.0:1783969312.265277:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1870627272133120:12345-192.168.203.39@tcp:8: 00010000:00080000:3.0:1783969312.265306:0:6595:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 03985e57-ffb4-414b-b30c-e72697857d4f@192.168.203.39@tcp t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:3.0:1783969312.265340:0:6595:0:(genops.c:1406:class_connect()) connect: client 03985e57-ffb4-414b-b30c-e72697857d4f, cookie 0xbacf56d076faad09 00002000:00100000:3.0:1783969312.265351:0:6595:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 03985e57-ffb4-414b-b30c-e72697857d4f/ffff9ac6827e3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783969312.265374:0:6595:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:3.0:1783969312.265986:0:6595:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783969312.266017:0:6595:0:(import.c:65:import_set_state_nolock()) ffff9ac6827e0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783969312.266086:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798167800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+6:2347:x1870627272133120:12345-192.168.203.39@tcp:8: Request processed in 807us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969312.266095:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:3.0:1783969312.271734:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969312.271781:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969312.271999:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272133376 00000100:00100000:1.0:1783969312.272009:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272133376 00000100:00100000:1.0:1783969312.272075:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:1.0:1783969312.272084:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+6:5567:x1870627272133376:12345-192.168.203.39@tcp:33: 00000100:00100000:2.0:1783969312.272578:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272133248 00000100:00100000:2.0:1783969312.272584:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272133248 00000100:00100000:2.0:1783969312.272616:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:2.0:1783969312.272621:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785317800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1870627272133248:12345-192.168.203.39@tcp:8: 00010000:00080000:2.0:1783969312.272647:0:6594:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 03985e57-ffb4-414b-b30c-e72697857d4f@192.168.203.39@tcp t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:2.0:1783969312.272675:0:6594:0:(genops.c:1406:class_connect()) connect: client 03985e57-ffb4-414b-b30c-e72697857d4f, cookie 0xbacf56d076faad10 00002000:00100000:2.0:1783969312.272685:0:6594:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 03985e57-ffb4-414b-b30c-e72697857d4f/ffff9ac7ba65a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783969312.272708:0:6594:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:2.0:1783969312.275136:0:6594:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783969312.275178:0:6594:0:(import.c:65:import_set_state_nolock()) ffff9ac7ba65d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783969312.275599:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785317800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+6:2347:x1870627272133248:12345-192.168.203.39@tcp:8: Request processed in 2974us (3871us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969312.275610:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 9 00010000:00010000:0.0:1783969312.297659:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783969312.304609:0:5796:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 32458us 00000004:00200000:3.0:1783969312.336941:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1783969312.337487:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+6:5567:x1870627272133376:12345-192.168.203.39@tcp:33: Request processed in 65398us (65698us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969312.337501:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:3.0:1783969312.567435:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969312.567604:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272133504 00000100:00100000:1.0:1783969312.567614:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272133504 00000100:00100000:1.0:1783969312.567666:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:1.0:1783969312.567676:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+6:5606:x1870627272133504:12345-192.168.203.39@tcp:101: 00010000:00010000:1.0:1783969312.567696:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969312.567721:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781497600/0xbacf56d076faad17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63031 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969312.567792:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faad1e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969312.567814:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faad1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969312.567829:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faad1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969312.568059:0:6618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1783969312.568064:0:6618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783969312.568140:0:6618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faad1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969312.568167:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781497600/0xbacf56d076faad17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63031 expref: 8 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969312.568184:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faad1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63031 expref: 7 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969312.568193:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac7829e0f00) 00010000:00010000:1.0:1783969312.568196:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783969312.568199:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac781496200, rc 0) 00000100:00100000:1.0:1783969312.568267:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+7:5606:x1870627272133504:12345-192.168.203.39@tcp:101: Request processed in 592us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969312.568274:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 8 00010000:00010000:1.0:1783969313.320020:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969313.381167:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783969313.381194:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280542976:0@lo:13: 00000100:00100000:2.0:1783969313.381262:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969313.382812:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280542976 00000100:00100000:3.0:1783969313.382826:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280542976 00000100:00100000:3.0:1783969313.382912:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783969313.382922:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280542976:12345-0@lo:13: 00002000:00000024:3.0:1783969313.382947:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783969313.383018:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280542976:12345-0@lo:13: Request processed in 99us (1756us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969313.383042:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1783969313.383109:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac798165f80 x1870627280542976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969313.383128:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798165f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280542976:0@lo:13: 00000100:00080000:1.0:1783969313.384160:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969313.893375:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280543232:0@lo:400: 00000100:00100000:1.0:1783969313.893442:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969313.893512:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969313.893519:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280543360:0@lo:400: 00000100:00100000:1.0:1783969313.893544:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969313.893581:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280543232 00000100:00100000:1.0:1783969313.893588:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280543232 00000100:00100000:1.0:1783969313.893625:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280543360 00000100:00100000:1.0:1783969313.893640:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280543360 00000100:00100000:1.0:1783969313.893673:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783969313.893682:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280543232:12345-0@lo:400: 00000100:00100000:1.0:1783969313.893732:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798165f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280543232:12345-0@lo:400: Request processed in 51us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969313.893740:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783969313.893768:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783969313.893775:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280543360:12345-0@lo:400: 00000100:00100000:1.0:1783969313.893803:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798164000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280543360:12345-0@lo:400: Request processed in 29us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969313.893810:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1783969313.893826:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969313.893855:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280543360:0@lo:400: 00000100:00100000:1.0:1783969313.893902:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280543232:0@lo:400: 00000100:00100000:2.0:1783969313.894006:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280543104:0@lo:400: 00000100:00100000:2.0:1783969313.894041:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969313.894072:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280543616:0@lo:400: 00000100:00100000:2.0:1783969313.894107:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969313.894125:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783969313.894131:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1870627280543488:0@lo:400: 00000100:00100000:2.0:1783969313.894153:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969313.894176:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280543488 00000100:00100000:2.0:1783969313.894180:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280543488 00000100:00100000:2.0:1783969313.894216:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783969313.894222:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1870627280543488:12345-0@lo:400: 00000100:00100000:2.0:1783969313.894255:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1870627280543488:12345-0@lo:400: Request processed in 33us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969313.894261:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1783969313.894274:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969313.894290:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1870627280543488:0@lo:400: 00000100:00100000:1.0:1783969313.894516:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280543104 00000100:00100000:1.0:1783969313.894520:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280543104 00000100:00100000:1.0:1783969313.894553:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783969313.894561:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:3286:x1870627280543104:12345-0@lo:400: 00000100:00100000:1.0:1783969313.894604:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:3286:x1870627280543104:12345-0@lo:400: Request processed in 44us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969313.894611:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783969313.894717:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280543104:0@lo:400: 00000100:00100000:3.0:1783969313.894788:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280543616 00000100:00100000:3.0:1783969313.894792:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280543616 00000100:00100000:3.0:1783969313.894843:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783969313.894851:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280543616:12345-0@lo:400: 00000100:00100000:3.0:1783969313.894955:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280543616:12345-0@lo:400: Request processed in 104us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969313.894962:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1783969313.895007:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac785316d80 x1870627280543616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969313.895016:0:3286:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1783969313.895028:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280543616:0@lo:400: 00000100:00080000:2.0:1783969313.895293:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783969314.342121:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969314.407055:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280543744:0@lo:13: 00000100:00100000:1.0:1783969314.407132:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969314.407344:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280543744 00000100:00100000:3.0:1783969314.407352:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280543744 00000100:00100000:3.0:1783969314.407414:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783969314.407424:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798166d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280543744:12345-0@lo:13: 00002000:00000024:3.0:1783969314.407458:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783969314.407518:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798166d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280543744:12345-0@lo:13: Request processed in 93us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969314.407526:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1783969314.407666:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac681f4c000 x1870627280543744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969314.407683:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280543744:0@lo:13: 00000100:00100000:2.0:1783969314.732928:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969314.733088:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272133632 00000100:00100000:0.0:1783969314.733097:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272133632 00000100:00100000:0.0:1783969314.733171:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:0.0:1783969314.733181:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+7:5658:x1870627272133632:12345-192.168.203.39@tcp:41: 00000004:00000024:0.0:1783969314.733222:0:5793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1783969314.733289:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+7:5658:x1870627272133632:12345-192.168.203.39@tcp:41: Request processed in 109us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969314.733309:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00080000:2.0:1783969314.733364:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969314.743634:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969314.743716:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272133760 00000100:00100000:3.0:1783969314.743725:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272133760 00000100:00100000:3.0:1783969314.743811:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:3.0:1783969314.743820:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:03985e57-ffb4-414b-b30c-e72697857d4f+6:5658:x1870627272133760:12345-192.168.203.39@tcp:13: 00002000:00000024:3.0:1783969314.743856:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783969314.743956:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:03985e57-ffb4-414b-b30c-e72697857d4f+6:5658:x1870627272133760:12345-192.168.203.39@tcp:13: Request processed in 136us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969314.743964:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00080000:2.0:1783969314.744258:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969314.748160:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969314.748340:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272133888 00000100:00100000:0.0:1783969314.748350:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272133888 00000100:00100000:0.0:1783969314.748429:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:0.0:1783969314.748440:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785316d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:03985e57-ffb4-414b-b30c-e72697857d4f+6:5658:x1870627272133888:12345-192.168.203.39@tcp:13: 00002000:00000024:0.0:1783969314.748466:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783969314.748531:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785316d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:03985e57-ffb4-414b-b30c-e72697857d4f+6:5658:x1870627272133888:12345-192.168.203.39@tcp:13: Request processed in 93us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969314.748540:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00080000:2.0:1783969314.748755:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1783969314.993301:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 03985e57-ffb4-414b-b30c-e72697857d4f 00010000:00010000:0.0:1783969315.366066:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969316.391012:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783969317.002809:0:5816:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 03985e57-ffb4-414b-b30c-e72697857d4f 00000001:00100000:2.0:1783969317.066451:0:7494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 03985e57-ffb4-414b-b30c-e72697857d4f 00010000:00010000:0.0:1783969317.413117:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969317.429575:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969317.429811:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272134144 00000100:00100000:1.0:1783969317.429821:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272134144 00000100:00100000:1.0:1783969317.429911:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:1.0:1783969317.429933:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+6:2350:x1870627272134144:12345-192.168.203.39@tcp:400: 00000100:00100000:1.0:1783969317.430004:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+6:2350:x1870627272134144:12345-192.168.203.39@tcp:400: Request processed in 73us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969317.430012:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00080000:2.0:1783969317.430487:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969317.446427:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969317.446469:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969317.446503:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969317.446589:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272134272 00000100:00100000:2.0:1783969317.446609:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272134272 00000100:00100000:2.0:1783969317.446676:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272134400 00000100:00100000:2.0:1783969317.446679:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272134400 00000100:00100000:2.0:1783969317.446699:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:2.0:1783969317.446731:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7aea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+5:2351:x1870627272134272:12345-192.168.203.39@tcp:400: 00000100:00100000:2.0:1783969317.446820:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7aea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+5:2351:x1870627272134272:12345-192.168.203.39@tcp:400: Request processed in 113us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969317.446829:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:2.0:1783969317.446846:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:2.0:1783969317.446852:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+5:2350:x1870627272134400:12345-192.168.203.39@tcp:400: 00000100:00100000:2.0:1783969317.446904:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7ae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+5:2350:x1870627272134400:12345-192.168.203.39@tcp:400: Request processed in 51us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969317.446911:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00080000:0.0:1783969317.447277:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783969317.447281:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969317.447509:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272134016 00000100:00100000:3.0:1783969317.447514:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272134016 00000100:00100000:3.0:1783969317.447558:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 127 00000100:00100000:3.0:1783969317.447566:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:2351:x1870627272134016:12345-192.168.203.39@tcp:400: 00000100:00100000:3.0:1783969317.447611:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:2351:x1870627272134016:12345-192.168.203.39@tcp:400: Request processed in 46us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969317.447616:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 127 00000001:02000400:1.0:1783969317.564854:0:8149:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1783969318.438010:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969318.503118:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280543872:0@lo:13: 00000100:00100000:1.0:1783969318.503182:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969318.503259:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280543872 00000100:00100000:1.0:1783969318.503265:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280543872 00000100:00100000:1.0:1783969318.503316:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783969318.503324:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280543872:12345-0@lo:13: 00002000:00000024:1.0:1783969318.503356:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783969318.503399:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280543872:12345-0@lo:13: Request processed in 75us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969318.503405:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1783969318.503422:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783969318.503449:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac78872c000 x1870627280543872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969318.503465:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280543872:0@lo:13: 00000100:00100000:2.0:1783969319.013334:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7aea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280544000:0@lo:400: 00000100:00100000:2.0:1783969319.013402:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969319.013453:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783969319.013460:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1870627280544128:0@lo:400: 00000100:00100000:2.0:1783969319.013487:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969319.013695:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280544256:0@lo:400: 00000100:00100000:0.0:1783969319.013748:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969319.013769:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783969319.013775:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280544384:0@lo:400: 00000100:00100000:0.0:1783969319.013802:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969319.013836:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280544000 00000100:00100000:0.0:1783969319.013843:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280544000 00000100:00100000:0.0:1783969319.013920:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783969319.013929:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3285:x1870627280544000:12345-0@lo:400: 00000100:00100000:0.0:1783969319.013974:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3285:x1870627280544000:12345-0@lo:400: Request processed in 46us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969319.013981:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1783969319.014014:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280544128 00000100:00100000:0.0:1783969319.014018:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280544128 00000100:00100000:2.0:1783969319.014420:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1870627280544512:0@lo:400: 00000100:00100000:2.0:1783969319.014452:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969319.014691:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7aeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280544640:0@lo:400: 00000100:00100000:3.0:1783969319.014974:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969319.016206:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7aea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280544000:0@lo:400: 00000100:00100000:2.0:1783969319.018252:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280544384 00000100:00100000:2.0:1783969319.018265:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280544384 00000100:00100000:2.0:1783969319.018311:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280544640 00000100:00100000:2.0:1783969319.018315:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280544640 00000100:00100000:2.0:1783969319.018341:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783969319.018349:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280544384:12345-0@lo:400: 00000100:00100000:2.0:1783969319.018439:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7aead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280544384:12345-0@lo:400: Request processed in 91us (4636us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969319.018447:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783969319.018472:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783969319.018478:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280544640:12345-0@lo:400: 00000100:00100000:2.0:1783969319.018514:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280544640:12345-0@lo:400: Request processed in 36us (3778us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969319.018520:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1783969319.018534:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783969319.018816:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280544256 00000100:00100000:0.0:1783969319.018822:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280544256 00010000:00080000:0.0:1783969319.018884:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7a7aebb80 x1870627280544384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969319.018898:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280544384:0@lo:400: 00000100:00100000:0.0:1783969319.018925:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280544512 00000100:00100000:0.0:1783969319.018928:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280544512 00000100:00100000:0.0:1783969319.018959:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783969319.018965:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1870627280544128:12345-0@lo:400: 00000100:00100000:0.0:1783969319.019005:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1870627280544128:12345-0@lo:400: Request processed in 39us (5517us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969319.019011:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783969319.019353:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783969319.019360:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1870627280544512:12345-0@lo:400: 00000100:00100000:0.0:1783969319.019392:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1870627280544512:12345-0@lo:400: Request processed in 33us (4940us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969319.019397:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783969319.019441:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783969319.019447:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280544256:12345-0@lo:400: 00000100:00100000:0.0:1783969319.019480:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7ae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280544256:12345-0@lo:400: Request processed in 33us (5741us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969319.019493:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783969319.019521:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280544256:0@lo:400: 00000100:00080000:2.0:1783969319.020175:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969319.020212:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1870627280544512:0@lo:400: 00000100:00100000:2.0:1783969319.020353:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1870627280544128:0@lo:400: 00010000:00080000:3.0:1783969319.023167:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7a7aeb100 x1870627280544640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969319.023184:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7aeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280544640:0@lo:400: 00010000:00010000:0.0:1783969319.461050:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969319.525155:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783969319.525181:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280544768:0@lo:13: 00000100:00100000:1.0:1783969319.525246:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969319.525352:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280544768 00000100:00100000:2.0:1783969319.525359:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280544768 00000100:00100000:2.0:1783969319.525407:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783969319.525416:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280544768:12345-0@lo:13: 00002000:00000024:2.0:1783969319.525448:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783969319.525627:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280544768:12345-0@lo:13: Request processed in 212us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969319.525635:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1783969319.529548:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac681f4f800 x1870627280544768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969335 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969319.529580:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280544768:0@lo:13: 00010000:00010000:0.0:1783969320.485367:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783969321.224486:0:8297:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc78654010 20000000:00000080:3.0:1783969321.224508:0:8297:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ac7b4da1c00 uarg=0000000000000000 20000000:01000000:3.0:1783969321.224543:0:8297:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1783969321.224546:0:8297:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1783969321.224548:0:8297:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1783969321.224553:0:8297:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1783969321.224557:0:8297:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1783969321.224569:0:8297:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1783969321.224571:0:8297:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1783969321.227362:0:8297:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1783969321.227368:0:8297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783969321.228245:0:8298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1783969321.229008:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1783969321.229157:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1783969321.229199:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1783969321.229210:0:8297:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1783969321.229212:0:8297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783969321.231618:0:8299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1783969321.232458:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1783969321.232501:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1783969321.232542:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1783969321.232554:0:8297:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1783969321.232556:0:8297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783969321.233567:0:8300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1783969321.234227:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1783969321.234367:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1783969321.234407:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1783969321.234419:0:8297:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1783969321.234421:0:8297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783969321.236191:0:8301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1783969321.237002:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1783969321.237153:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1783969321.237198:0:8297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1783969321.237217:0:8297:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783969321.237235:0:8297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac783de7a00/0xbacf56d076faad25 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.237252:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac780031600/0xbacf56d076faac22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faac1b expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.237268:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac7c21e2a00/0xbacf56d076faac4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faac45 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.237345:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac7c21e3c00/0xbacf56d076faac76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faac6f expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.237352:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac783de7800/0xbacf56d076faac84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faac7d expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.237358:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac783de7200/0xbacf56d076faac92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faac8b expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.237364:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac780031400/0xbacf56d076faacae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faaca7 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.237370:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac7bfb93e00/0xbacf56d076faacd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faacd1 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.237379:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac781497200/0xbacf56d076faace6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb62fcf expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.237386:0:8297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac783de6000/0xbacf56d076faaced lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb62fd6 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.237393:0:8297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ac783de7a00/0xbacf56d076faad25 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.237435:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac783de6000/0xbacf56d076faaced lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb62fd6 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.237461:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac783de6000/0xbacf56d076faaced lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb62fd6 expref: 9 pid: 5787 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969321.237475:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785315c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870627280544896:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783969321.237798:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac781497200/0xbacf56d076faace6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb62fcf expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.237807:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac781497200/0xbacf56d076faace6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb62fcf expref: 9 pid: 5788 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969321.237817:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870627280545024:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783969321.237852:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac7bfb93e00/0xbacf56d076faacd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faacd1 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.237888:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac7bfb93e00/0xbacf56d076faacd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faacd1 expref: 18 pid: 5786 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969321.237898:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785315880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870627280545152:0@lo:104: 00000100:00100000:3.0:1783969321.237935:0:8297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783969321.237975:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac780031400/0xbacf56d076faacae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faaca7 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.237983:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac780031400/0xbacf56d076faacae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faaca7 expref: 18 pid: 5788 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969321.237991:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba612300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870627280545280:0@lo:104: 00000100:00100000:3.0:1783969321.238014:0:8297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783969321.238051:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac783de7200/0xbacf56d076faac92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faac8b expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.238059:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac783de7200/0xbacf56d076faac92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faac8b expref: 18 pid: 5788 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969321.238136:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba611880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870627280545408:0@lo:104: 00010000:00010000:3.0:1783969321.238165:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac783de7800/0xbacf56d076faac84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faac7d expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.238173:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac783de7800/0xbacf56d076faac84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faac7d expref: 18 pid: 5787 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969321.238180:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba610e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870627280545536:0@lo:104: 00010000:00010000:3.0:1783969321.238202:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac7c21e3c00/0xbacf56d076faac76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faac6f expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.238210:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac7c21e3c00/0xbacf56d076faac76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faac6f expref: 18 pid: 5787 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969321.238217:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba611180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870627280545664:0@lo:104: 00010000:00010000:3.0:1783969321.238242:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac7c21e2a00/0xbacf56d076faac4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faac45 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.238250:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac7c21e2a00/0xbacf56d076faac4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faac45 expref: 18 pid: 5787 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969321.238258:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba611500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870627280545792:0@lo:104: 00000100:00100000:1.0:1783969321.238386:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783969321.238409:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969321.238422:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969321.238429:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969321.238437:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280545152 00000100:00100000:1.0:1783969321.238442:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280545152 00000100:00100000:1.0:1783969321.238475:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280545280 00000100:00100000:1.0:1783969321.238478:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280545280 00000100:00100000:1.0:1783969321.238487:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280545408 00000100:00100000:1.0:1783969321.238489:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280545408 00000100:00100000:1.0:1783969321.238497:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280545536 00000100:00100000:1.0:1783969321.238499:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280545536 00000100:00100000:1.0:1783969321.238506:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280545664 00000100:00100000:1.0:1783969321.238508:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280545664 00000100:00100000:1.0:1783969321.238520:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783969321.238528:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785316680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+7:8297:x1870627280545152:12345-0@lo:104: 00010000:00010000:1.0:1783969321.238539:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac780031000/0xbacf56d076faacd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faacd8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969321.238955:0:8297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783969321.238988:0:8297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac780031600/0xbacf56d076faac22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faac1b expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.239003:0:8297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac780031600/0xbacf56d076faac22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faac1b expref: 18 pid: 5786 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969321.239012:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1533b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870627280545920:0@lo:104: 00000100:00100000:3.0:1783969321.239048:0:8297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969321.239059:0:8297:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa2d240 going to sleep for 11 seconds 00000100:00100000:2.0:1783969321.239167:0:5777:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1783969321.239175:0:5777:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1783969321.239361:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783969321.239369:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785316680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+7:8297:x1870627280545152:12345-0@lo:104: Request processed in 842us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969321.239376:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783969321.239399:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280545792 00000100:00100000:1.0:1783969321.239403:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280545792 00000100:00100000:1.0:1783969321.239418:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280545920 00000100:00100000:1.0:1783969321.239420:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280545920 00000100:00100000:1.0:1783969321.239430:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783969321.239435:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1700450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+8:8297:x1870627280545280:12345-0@lo:104: 00010000:00010000:1.0:1783969321.239443:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac781496a00/0xbacf56d076faaca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faacae expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969321.239495:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783969321.239500:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1700450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+8:8297:x1870627280545280:12345-0@lo:104: Request processed in 65us (1485us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969321.239506:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783969321.239567:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783969321.239761:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785315880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870627280545152:0@lo:104: 00000100:00100000:3.0:1783969321.239776:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba612300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870627280545280:0@lo:104: 00010000:00010000:0.0:1783969321.240053:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1783969321.240056:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+7:8297:x1870627280545408:12345-0@lo:104: 00010000:00010000:0.0:1783969321.240061:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac780031000/0xbacf56d076faacd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faacd8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969321.240072:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac780031000 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:0.0:1783969321.240076:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac780031000/0xbacf56d076faacd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faacd8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969321.240079:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faac8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faac92 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969321.240093:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac780031000/0xbacf56d076faacd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faacd8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969321.240103:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac780031000/0xbacf56d076faacd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faacd8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969321.240109:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783969321.240135:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783969321.240142:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+7:8297:x1870627280545408:12345-0@lo:104: Request processed in 569us (1732us total) trans 0 rc 0/0 00010000:00010000:0.0:1783969321.240144:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac780031000/0xbacf56d076faacd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faacd8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969321.240152:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1783969321.240156:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783969321.240173:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1783969321.240177:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac780031000/0xbacf56d076faacd1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faacd8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969321.240183:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+6:8297:x1870627280545536:12345-0@lo:104: 00010000:00010000:1.0:1783969321.240191:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faac7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faac84 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969321.240218:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783969321.240223:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+6:8297:x1870627280545536:12345-0@lo:104: Request processed in 44us (1800us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969321.240228:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783969321.240238:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783969321.240244:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+5:8297:x1870627280545664:12345-0@lo:104: 00010000:00010000:1.0:1783969321.240251:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac780031200/0xbacf56d076faac6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faac76 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969321.240298:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1783969321.240303:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+5:8297:x1870627280545664:12345-0@lo:104: Request processed in 59us (1873us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969321.240316:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1783969321.240319:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac780031000/0xbacf56d076faacd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faacd8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969321.240330:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1783969321.240336:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:1.0:1783969321.240339:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1532a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+4:8297:x1870627280545792:12345-0@lo:104: 00010000:00010000:1.0:1783969321.240348:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac783de6a00/0xbacf56d076faac45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faac4c expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969321.240348:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac781496a00/0xbacf56d076faaca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faacae expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969321.240366:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac781496a00 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:0.0:1783969321.240370:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac781496a00/0xbacf56d076faaca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faacae expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969321.240378:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac781496a00/0xbacf56d076faaca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faacae expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969321.240386:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac781496a00/0xbacf56d076faaca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faacae expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969321.240389:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 10000000:01000000:0.0:1783969321.240393:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1783969321.240399:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1532a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+4:8297:x1870627280545792:12345-0@lo:104: Request processed in 60us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969321.240405:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1783969321.240414:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac781496a00/0xbacf56d076faaca7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faacae expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969321.240421:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1783969321.240426:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1783969321.240431:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1533480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+3:8297:x1870627280545920:12345-0@lo:104: 00010000:00010000:1.0:1783969321.240440:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac780030600/0xbacf56d076faac1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faac22 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969321.240443:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac781496a00/0xbacf56d076faaca7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faacae expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969321.240452:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac781496a00/0xbacf56d076faaca7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faacae expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969321.240465:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783969321.240469:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:0.0:1783969321.240469:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faac8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faac92 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969321.240480:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1533480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+3:8297:x1870627280545920:12345-0@lo:104: Request processed in 49us (1430us total) trans 0 rc 0/0 00010000:00010000:0.0:1783969321.240481:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac781497400 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:0.0:1783969321.240487:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faac8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faac92 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969321.240492:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1783969321.240510:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faac8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faac92 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969321.240511:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 10000000:00010000:0.0:1783969321.240522:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faac8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faac92 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969321.240527:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783969321.240542:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faac8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faac92 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969321.240548:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969321.240552:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faac8b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faac92 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969321.240559:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac781497400/0xbacf56d076faac8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faac92 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969321.240569:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783969321.240571:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac780031200/0xbacf56d076faac6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faac76 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969321.240577:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac780031200 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:0.0:1783969321.240579:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac780031200/0xbacf56d076faac6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faac76 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969321.240586:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac780031200/0xbacf56d076faac6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faac76 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969321.240592:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac780031200/0xbacf56d076faac6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faac76 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969321.240604:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783969321.240618:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac780031200/0xbacf56d076faac6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faac76 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969321.240624:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969321.240630:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac780031200/0xbacf56d076faac6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faac76 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969321.240637:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac780031200/0xbacf56d076faac6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faac76 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969321.240646:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783969321.240649:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac783de6a00/0xbacf56d076faac45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faac4c expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969321.240655:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6a00 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:0.0:1783969321.240657:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac783de6a00/0xbacf56d076faac45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faac4c expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969321.240663:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac783de6a00/0xbacf56d076faac45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faac4c expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969321.240669:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac783de6a00/0xbacf56d076faac45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faac4c expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969321.240674:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783969321.240686:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac783de6a00/0xbacf56d076faac45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faac4c expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969321.240691:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969321.240714:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac783de6a00/0xbacf56d076faac45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faac4c expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969321.240718:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba611880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870627280545408:0@lo:104: 00010000:00010000:0.0:1783969321.240724:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac783de6a00/0xbacf56d076faac45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faac4c expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969321.240731:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba610e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870627280545536:0@lo:104: 00010000:00010000:0.0:1783969321.240737:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969321.240741:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac780030600/0xbacf56d076faac1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faac22 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969321.240742:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba611180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870627280545664:0@lo:104: 00010000:00010000:0.0:1783969321.240755:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac780030600 already unused, calling callback (ffffffffc1a6bc20) 00000100:00100000:3.0:1783969321.240757:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba611500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870627280545792:0@lo:104: 10000000:00010000:0.0:1783969321.240760:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac780030600/0xbacf56d076faac1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faac22 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969321.240767:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1533b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870627280545920:0@lo:104: 00010000:00010000:0.0:1783969321.240770:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac780030600/0xbacf56d076faac1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faac22 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969321.240779:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac780030600/0xbacf56d076faac1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faac22 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969321.240785:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783969321.240799:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac780030600/0xbacf56d076faac1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faac22 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969321.240805:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969321.240809:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac780030600/0xbacf56d076faac1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faac22 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969321.240815:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac780030600/0xbacf56d076faac1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faac22 expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969321.240824:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969321.240830:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969321.240832:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969321.240847:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280546048:0@lo:103: 00000100:00100000:0.0:1783969321.240921:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969321.240953:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280546560:0@lo:103: 00000100:00100000:0.0:1783969321.240973:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969321.240992:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783969321.240998:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280546432:0@lo:103: 00000100:00100000:0.0:1783969321.241083:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969321.241125:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7ae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280546304:0@lo:103: 00000100:00100000:3.0:1783969321.241145:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280546048 00000100:00100000:0.0:1783969321.241151:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969321.241153:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280546048 00000100:00100000:0.0:1783969321.241166:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783969321.241174:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280546176:0@lo:103: 00010000:00010000:3.0:1783969321.241181:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac7bfb93e00/0xbacf56d076faacd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faacd1 expref: 19 pid: 5786 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969321.241198:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280546560 00000100:00100000:3.0:1783969321.241201:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280546560 00010000:00010000:3.0:1783969321.241212:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac7c21e2a00/0xbacf56d076faac4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faac45 expref: 20 pid: 5787 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969321.241222:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280546432 00000100:00100000:3.0:1783969321.241224:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280546432 00010000:00010000:3.0:1783969321.241232:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac7c21e3c00/0xbacf56d076faac76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faac6f expref: 21 pid: 5787 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969321.241256:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280546304 00000100:00100000:3.0:1783969321.241260:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280546304 00010000:00010000:3.0:1783969321.241282:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac783de7200/0xbacf56d076faac92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faac8b expref: 22 pid: 5788 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969321.241294:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783969321.241301:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c893ad09-f78f-4711-bea5-6489668294ed+22:3288:x1870627280546048:12345-0@lo:103: 00010000:00010000:3.0:1783969321.241323:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1783969321.241324:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783969321.241333:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac7bfb93e00/0xbacf56d076faacd8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faacd1 expref: 22 pid: 5786 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969321.241340:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280546688:0@lo:103: 00010000:00010000:3.0:1783969321.241346:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac7bfb93e00/0xbacf56d076faacd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faacd1 expref: 22 pid: 5786 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.241364:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7bfb93e00/0xbacf56d076faacd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faacd1 expref: 22 pid: 5786 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969321.241368:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783969321.241384:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969321.241393:0:5780:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1783969321.241402:0:5780:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1783969321.241428:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c893ad09-f78f-4711-bea5-6489668294ed+21:3288:x1870627280546048:12345-0@lo:103: Request processed in 127us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969321.241436:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783969321.241444:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280546048:0@lo:103: 00000100:00100000:3.0:1783969321.241451:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280546176 00000100:00100000:3.0:1783969321.241456:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280546176 00010000:00010000:3.0:1783969321.241469:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac780031400/0xbacf56d076faacae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faaca7 expref: 21 pid: 5788 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969321.241480:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280546688 00000100:00100000:3.0:1783969321.241482:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280546688 00010000:00010000:3.0:1783969321.241491:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac780031600/0xbacf56d076faac22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faac1b expref: 22 pid: 5786 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969321.241511:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783969321.241516:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c893ad09-f78f-4711-bea5-6489668294ed+22:3288:x1870627280546560:12345-0@lo:103: 00010000:00010000:3.0:1783969321.241523:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969321.241527:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac7c21e2a00/0xbacf56d076faac4c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faac45 expref: 22 pid: 5787 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.241536:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac7c21e2a00/0xbacf56d076faac4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faac45 expref: 22 pid: 5787 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.241546:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7c21e2a00/0xbacf56d076faac4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faac45 expref: 22 pid: 5787 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.241556:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969321.241602:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c893ad09-f78f-4711-bea5-6489668294ed+21:3288:x1870627280546560:12345-0@lo:103: Request processed in 85us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969321.241609:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783969321.241624:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783969321.241631:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280546560:0@lo:103: 00000100:00100000:3.0:1783969321.241632:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c893ad09-f78f-4711-bea5-6489668294ed+20:3288:x1870627280546432:12345-0@lo:103: 00010000:00010000:3.0:1783969321.241644:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969321.241648:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac7c21e3c00/0xbacf56d076faac76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faac6f expref: 20 pid: 5787 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.241656:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac7c21e3c00/0xbacf56d076faac76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faac6f expref: 20 pid: 5787 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.241665:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7c21e3c00/0xbacf56d076faac76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faac6f expref: 20 pid: 5787 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.241841:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969321.241895:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c893ad09-f78f-4711-bea5-6489668294ed+19:3288:x1870627280546432:12345-0@lo:103: Request processed in 264us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969321.241901:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783969321.241915:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783969321.241922:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7aea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c893ad09-f78f-4711-bea5-6489668294ed+18:3286:x1870627280546304:12345-0@lo:103: 00010000:00010000:3.0:1783969321.241931:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969321.241936:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac783de7200/0xbacf56d076faac92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faac8b expref: 18 pid: 5788 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.241944:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac783de7200/0xbacf56d076faac92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faac8b expref: 18 pid: 5788 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.241955:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac783de7200/0xbacf56d076faac92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faac8b expref: 18 pid: 5788 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.241965:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969321.241999:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7aea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c893ad09-f78f-4711-bea5-6489668294ed+17:3286:x1870627280546304:12345-0@lo:103: Request processed in 78us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969321.242004:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783969321.242016:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783969321.242022:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c893ad09-f78f-4711-bea5-6489668294ed+16:3286:x1870627280546176:12345-0@lo:103: 00010000:00010000:3.0:1783969321.242029:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969321.242032:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac780031400/0xbacf56d076faacae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faaca7 expref: 16 pid: 5788 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.242039:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac780031400/0xbacf56d076faacae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faaca7 expref: 16 pid: 5788 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.242056:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac780031400/0xbacf56d076faacae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faaca7 expref: 16 pid: 5788 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969321.242077:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783969321.242087:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c893ad09-f78f-4711-bea5-6489668294ed+15:3286:x1870627280546688:12345-0@lo:103: 00010000:00010000:0.0:1783969321.242096:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969321.242101:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac780031600/0xbacf56d076faac22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faac1b expref: 15 pid: 5786 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969321.242107:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7ae9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280546304:0@lo:103: 00010000:00010000:0.0:1783969321.242120:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac780031600/0xbacf56d076faac22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faac1b expref: 15 pid: 5786 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969321.242131:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac780031600/0xbacf56d076faac22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faac1b expref: 15 pid: 5786 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969321.242478:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969321.242515:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c893ad09-f78f-4711-bea5-6489668294ed+14:3286:x1870627280546688:12345-0@lo:103: Request processed in 430us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969321.242521:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7ae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280546688:0@lo:103: 00000100:00100000:0.0:1783969321.242523:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783969321.242546:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7ae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280546432:0@lo:103: 00010000:00010000:3.0:1783969321.242922:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969321.242960:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a80000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c893ad09-f78f-4711-bea5-6489668294ed+13:3286:x1870627280546176:12345-0@lo:103: Request processed in 938us (1636us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969321.242968:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783969321.243014:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280546176:0@lo:103: 00010000:00010000:0.0:1783969321.243449:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969321.243453:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969321.243458:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969321.243490:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faac7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faac84 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969321.243500:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac781497800 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:1.0:1783969321.243510:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faac7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faac84 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969321.243520:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faac7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faac84 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783969321.243526:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faac7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faac84 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969321.243532:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1783969321.243998:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:1.0:1783969321.244186:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faac7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faac84 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969321.244194:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783969321.244216:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faac7d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faac84 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969321.244223:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faac7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faac84 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969321.244236:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969321.244238:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969321.244239:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969321.244340:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785315c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870627280544896:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783969321.244353:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8297:1870627280545024:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783969321.244411:0:8297:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ac783de7a00/0xbacf56d076faad25 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969321.244460:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280546816:0@lo:103: 00000100:00100000:0.0:1783969321.244495:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969321.244533:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272134528 00000100:00100000:0.0:1783969321.244538:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272134528 00010000:00010000:0.0:1783969321.244559:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac783de6000/0xbacf56d076faaced lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb62fd6 expref: 10 pid: 5787 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969321.244833:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280546816 00000100:00100000:0.0:1783969321.244837:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280546816 00010000:00010000:0.0:1783969321.244850:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac783de7800/0xbacf56d076faac84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faac7d expref: 13 pid: 5787 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969321.244980:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:2.0:1783969321.244990:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a62850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:2351:x1870627272134528:12345-192.168.203.39@tcp:103: 00010000:00010000:2.0:1783969321.245001:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969321.245013:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac783de6000/0xbacf56d076faaced lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb62fd6 expref: 10 pid: 5787 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969321.245024:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac783de6000/0xbacf56d076faaced lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb62fd6 expref: 10 pid: 5787 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969321.245039:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac783de6000/0xbacf56d076faaced lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb62fd6 expref: 10 pid: 5787 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969321.245051:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969321.245101:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a62850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+9:2351:x1870627272134528:12345-192.168.203.39@tcp:103: Request processed in 113us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969321.245108:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:2.0:1783969321.245143:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783969321.245149:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c893ad09-f78f-4711-bea5-6489668294ed+13:3286:x1870627280546816:12345-0@lo:103: 00010000:00010000:2.0:1783969321.245157:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969321.245161:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac783de7800/0xbacf56d076faac84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faac7d expref: 13 pid: 5787 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969321.245169:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac783de7800/0xbacf56d076faac84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faac7d expref: 13 pid: 5787 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969321.245179:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac783de7800/0xbacf56d076faac84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faac7d expref: 13 pid: 5787 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969321.245187:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969321.245217:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c893ad09-f78f-4711-bea5-6489668294ed+12:3286:x1870627280546816:12345-0@lo:103: Request processed in 68us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969321.245223:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783969321.245249:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280546816:0@lo:103: 00000100:00100000:0.0:1783969321.246348:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969321.246447:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272134656 00000100:00100000:2.0:1783969321.246454:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272134656 00010000:00010000:2.0:1783969321.246480:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac781497200/0xbacf56d076faace6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb62fcf expref: 9 pid: 5788 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969321.246509:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:2.0:1783969321.246517:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+9:2348:x1870627272134656:12345-192.168.203.39@tcp:103: 00010000:00010000:2.0:1783969321.246528:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969321.246533:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac781497200/0xbacf56d076faace6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb62fcf expref: 9 pid: 5788 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969321.246544:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac781497200/0xbacf56d076faace6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb62fcf expref: 9 pid: 5788 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969321.246559:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac781497200/0xbacf56d076faace6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb62fcf expref: 9 pid: 5788 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969321.246787:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ac783de7a00/0xbacf56d076faad25 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969321.246798:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac783de7a00/0xbacf56d076faad25 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969321.246815:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac783de7a00/0xbacf56d076faad25 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969321.246822:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac783de7a00/0xbacf56d076faad25 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969321.246829:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac783de7a00/0xbacf56d076faad25 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969321.246844:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac783de7a00/0xbacf56d076faad25 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969321.246850:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de7a00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:2.0:1783969321.246854:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac783de7a00/0xbacf56d076faad25 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969321.246993:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac783de7a00/0xbacf56d076faad25 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.247153:0:8297:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ac783de7a00/0xbacf56d076faad25 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969321.247162:0:8297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac783de7a00/0xbacf56d076faad25 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969321.248972:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac783de7a00/0xbacf56d076faad25 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969321.248989:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac783de7a00/0xbacf56d076faad25 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969321.249008:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969321.250097:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+8:2348:x1870627272134656:12345-192.168.203.39@tcp:103: Request processed in 3573us (3746us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969321.250112:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 20 00010000:00010000:0.0:1783969321.509433:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783969322.469156:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783969322.469164:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ac7bf7a8800 from 39 10000000:01000000:2.0:1783969322.469170:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783969322.469220:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faad2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969322.469232:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faad2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969322.469243:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faad2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969322.469269:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280546944:0@lo:101: 00000100:00100000:2.0:1783969322.469360:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969322.469418:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac799f73cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969322.469509:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280546944 00000100:00100000:0.0:1783969322.469517:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280546944 00000100:00100000:0.0:1783969322.469574:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783969322.469583:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+12:5790:x1870627280546944:12345-0@lo:101: 00010000:00010000:0.0:1783969322.469595:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969322.469608:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7bfb93200/0xbacf56d076faad33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faad2c expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969322.469628:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7bfb93200/0xbacf56d076faad33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faad2c expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969322.469638:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7bfb93200/0xbacf56d076faad33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faad2c expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969322.469646:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93200, rc 0) 00000100:00100000:0.0:1783969322.469710:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+13:5790:x1870627280546944:12345-0@lo:101: Request processed in 128us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969322.469716:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1783969322.469900:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280546944:0@lo:101: 00010000:00010000:3.0:1783969322.469917:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faad2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad33 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969322.469925:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faad2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faad33 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969322.469979:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1533b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280547072:0@lo:501: 00000100:00100000:3.0:1783969322.470006:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969322.470035:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa2de40 going to sleep for 11 seconds 00000100:00100000:0.0:1783969322.470086:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280547072 00000100:00100000:0.0:1783969322.470090:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280547072 00000100:00100000:0.0:1783969322.470120:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1783969322.470126:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+13:5790:x1870627280547072:12345-0@lo:501: 00000100:00100000:0.0:1783969322.470351:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+13:5790:x1870627280547072:12345-0@lo:501: Request processed in 224us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969322.470357:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1783969322.470463:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1533b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280547072:0@lo:501: 00000100:00100000:3.0:1783969322.470491:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1533b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280547200:0@lo:503: 00000100:00100000:3.0:1783969322.470528:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969322.470548:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa2de40 going to sleep for 11 seconds 00000100:00100000:2.0:1783969322.470646:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280547200 00000100:00100000:2.0:1783969322.470651:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280547200 00000100:00100000:2.0:1783969322.470680:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783969322.470686:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+13:5790:x1870627280547200:12345-0@lo:503: 00000100:00100000:2.0:1783969322.471021:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+13:5790:x1870627280547200:12345-0@lo:503: Request processed in 334us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969322.471027:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1783969322.471108:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1533b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280547200:0@lo:503: 00000100:00100000:0.0:1783969322.471474:0:8317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a83800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8317:1870627280547328:0@lo:502: 00000100:00100000:0.0:1783969322.471510:0:8317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969322.471540:0:8317:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b5224f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969322.471589:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280547328 00000100:00100000:1.0:1783969322.471593:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280547328 00000100:00100000:1.0:1783969322.471629:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1783969322.471636:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+13:8317:x1870627280547328:12345-0@lo:502: 00000100:00100000:1.0:1783969322.471841:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+13:8317:x1870627280547328:12345-0@lo:502: Request processed in 205us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969322.471848:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1783969322.472207:0:8317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a83800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8317:1870627280547328:0@lo:502: 00000100:00100000:0.0:1783969322.472253:0:8317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a83800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8317:1870627280547456:0@lo:502: 00000100:00100000:0.0:1783969322.472287:0:8317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969322.472319:0:8317:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b5224f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783969322.472372:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280547456 00000100:00100000:3.0:1783969322.472376:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280547456 00000100:00100000:3.0:1783969322.472409:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783969322.472416:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+13:8317:x1870627280547456:12345-0@lo:502: 00000100:00100000:3.0:1783969322.472575:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+13:8317:x1870627280547456:12345-0@lo:502: Request processed in 158us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969322.472581:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783969322.472660:0:8317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a83800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8317:1870627280547456:0@lo:502: 00000040:00080000:0.0:1783969322.472679:0:8317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1783969322.472978:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1783969322.472998:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783969322.473007:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faad2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad33 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969322.473017:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faad2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad33 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969322.473026:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1783969322.473029:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1783969322.473032:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783969322.473055:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de7200/0xbacf56d076faad3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969322.473063:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac783de7200/0xbacf56d076faad3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969322.473080:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac783de7200/0xbacf56d076faad3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969322.473094:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1533b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280547584:0@lo:101: 00000100:00100000:3.0:1783969322.473123:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969322.473153:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa2dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969322.473198:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280547584 00000100:00100000:0.0:1783969322.473203:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280547584 00000100:00100000:0.0:1783969322.473235:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783969322.473243:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+13:5790:x1870627280547584:12345-0@lo:101: 00010000:00010000:0.0:1783969322.473252:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969322.473264:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7bfb93400/0xbacf56d076faad41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faad3a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969322.473283:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7bfb93400/0xbacf56d076faad41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faad3a expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969322.473293:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7bfb93400/0xbacf56d076faad41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faad3a expref: 14 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969322.473301:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93400, rc 0) 00000100:00100000:0.0:1783969322.473338:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+14:5790:x1870627280547584:12345-0@lo:101: Request processed in 97us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969322.473344:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783969322.473449:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1533b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280547584:0@lo:101: 00010000:00010000:3.0:1783969322.473462:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac783de7200/0xbacf56d076faad3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad41 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969322.473471:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac783de7200/0xbacf56d076faad3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faad41 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969322.473514:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1533b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280547712:0@lo:501: 00000100:00100000:3.0:1783969322.473538:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969322.473559:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa2dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969322.473607:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280547712 00000100:00100000:1.0:1783969322.473611:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280547712 00000100:00100000:1.0:1783969322.473641:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783969322.473648:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+14:5790:x1870627280547712:12345-0@lo:501: 00000100:00100000:1.0:1783969322.473998:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+14:5790:x1870627280547712:12345-0@lo:501: Request processed in 349us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969322.474006:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783969322.476916:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1533b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280547712:0@lo:501: 00000100:00100000:3.0:1783969322.476986:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1533b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280547840:0@lo:503: 00000100:00100000:3.0:1783969322.478662:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969322.478715:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa2dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969322.480148:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280547840 00000100:00100000:2.0:1783969322.480160:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280547840 00000100:00100000:2.0:1783969322.480732:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783969322.480745:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+14:5790:x1870627280547840:12345-0@lo:503: 00000100:00100000:2.0:1783969322.491581:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+14:5790:x1870627280547840:12345-0@lo:503: Request processed in 10830us (12916us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969322.491597:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1783969322.493558:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1533b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280547840:0@lo:503: 00000100:00100000:0.0:1783969322.494062:0:8318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a83800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8318:1870627280547968:0@lo:502: 00000100:00100000:0.0:1783969322.494129:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969322.494173:0:8318:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b5224d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783969322.494527:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280547968 00000100:00100000:2.0:1783969322.494533:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280547968 00000100:00100000:2.0:1783969322.494580:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1783969322.494589:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+14:8318:x1870627280547968:12345-0@lo:502: 00000100:00100000:2.0:1783969322.494818:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+14:8318:x1870627280547968:12345-0@lo:502: Request processed in 229us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969322.494826:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783969322.494849:0:8318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a83800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8318:1870627280547968:0@lo:502: 00000020:01000000:1.0:1783969322.494899:0:8318:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969322.494908:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969322.494910:0:8318:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783969322.494915:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783969322.494942:0:8318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8318:1870627280548096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969322.494979:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969322.495001:0:8318:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b5013900 going to sleep for 11 seconds 00000100:00100000:0.0:1783969322.495078:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280548096 00000100:00100000:0.0:1783969322.495083:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280548096 00000100:00100000:0.0:1783969322.495107:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1783969322.495113:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+14:8318:x1870627280548096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969322.495235:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+14:8318:x1870627280548096:12345-0@lo:502:llog_process_th.0 Request processed in 121us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969322.495242:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783969322.495769:0:8318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8318:1870627280548096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783969322.495794:0:8318:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783969322.495800:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969322.495802:0:8318:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783969322.495813:0:8318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1783969322.495895:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1783969322.495914:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783969322.495925:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de7200/0xbacf56d076faad3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad41 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969322.495947:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac783de7200/0xbacf56d076faad3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad41 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969322.495957:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783969322.495960:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ac7ba5f7000 from 39 10000000:01000000:3.0:1783969322.495962:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783969322.495987:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de6200/0xbacf56d076faad48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969322.495997:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac783de6200/0xbacf56d076faad48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969322.496006:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac783de6200/0xbacf56d076faad48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969322.496021:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1533b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280548224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783969322.496057:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969322.496086:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa2dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969322.496151:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280548224 00000100:00100000:0.0:1783969322.496156:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280548224 00000100:00100000:0.0:1783969322.496188:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1783969322.496195:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+14:5790:x1870627280548224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969322.496204:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969322.496217:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7bfb93a00/0xbacf56d076faad4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faad48 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969322.496237:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7bfb93a00/0xbacf56d076faad4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faad48 expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969322.496247:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7bfb93a00/0xbacf56d076faad4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faad48 expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969322.496255:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93a00, rc 0) 00000100:00100000:0.0:1783969322.496288:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+15:5790:x1870627280548224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969322.496294:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1783969322.496401:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1533b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280548224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783969322.496414:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac783de6200/0xbacf56d076faad48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad4f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969322.496424:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac783de6200/0xbacf56d076faad48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faad4f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969322.496468:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280548352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969322.496494:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969322.496516:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b5013240 going to sleep for 11 seconds 00000100:00100000:0.0:1783969322.496561:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280548352 00000100:00100000:0.0:1783969322.496565:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280548352 00000100:00100000:0.0:1783969322.496596:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783969322.496602:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+15:5790:x1870627280548352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969322.497879:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+15:5790:x1870627280548352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1250us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969322.497902:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783969322.498109:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280548352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969322.498157:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1533100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280548480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969322.498199:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969322.498263:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa2d180 going to sleep for 11 seconds 00000100:00100000:0.0:1783969322.498297:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280548480 00000100:00100000:0.0:1783969322.498302:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280548480 00000100:00100000:0.0:1783969322.498359:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1783969322.498367:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+15:5790:x1870627280548480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783969322.498521:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+15:5790:x1870627280548480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969322.498528:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783969322.498595:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1533100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280548480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969322.499181:0:8319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1533100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8319:1870627280548608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969322.499219:0:8319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969322.499404:0:8319:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa2db40 going to sleep for 11 seconds 00000100:00100000:1.0:1783969322.499475:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280548608 00000100:00100000:1.0:1783969322.499481:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280548608 00000100:00100000:1.0:1783969322.499506:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783969322.499513:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+15:8319:x1870627280548608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969322.499726:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+15:8319:x1870627280548608:12345-0@lo:502:llog_process_th.0 Request processed in 212us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969322.499733:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783969322.499821:0:8319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1533100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8319:1870627280548608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969322.499892:0:8319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1533100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8319:1870627280548736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969322.499927:0:8319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969322.499940:0:8319:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa2db40 going to sleep for 11 seconds 00000100:00100000:1.0:1783969322.500082:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280548736 00000100:00100000:1.0:1783969322.500086:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280548736 00000100:00100000:1.0:1783969322.500106:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783969322.500113:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+15:8319:x1870627280548736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969322.500256:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+15:8319:x1870627280548736:12345-0@lo:502:llog_process_th.0 Request processed in 144us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969322.500263:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783969322.500371:0:8319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1533100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8319:1870627280548736:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783969322.500391:0:8319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1783969322.500537:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1783969322.500555:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783969322.500565:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de6200/0xbacf56d076faad48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad4f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969322.500576:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac783de6200/0xbacf56d076faad48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad4f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969322.500585:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1783969322.500587:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1783969322.500590:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783969322.500613:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faad56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969322.500628:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faad56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969322.500637:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faad56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969322.500652:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280548864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783969322.500682:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969322.500763:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b5013e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783969322.501014:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280548864 00000100:00100000:3.0:1783969322.501019:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280548864 00000100:00100000:3.0:1783969322.501041:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1783969322.501047:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+15:5790:x1870627280548864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969322.501056:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969322.501068:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac783de7000/0xbacf56d076faad5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faad56 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969322.501089:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac783de7000/0xbacf56d076faad5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faad56 expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969322.501099:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac783de7000/0xbacf56d076faad5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faad56 expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969322.501108:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7000, rc 0) 00000100:00100000:3.0:1783969322.501138:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+16:5790:x1870627280548864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969322.501143:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783969322.501211:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280548864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783969322.501225:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faad56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad5d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969322.501234:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faad56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faad5d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969322.501279:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280548992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969322.501304:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969322.501330:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b5013e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783969322.501375:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280548992 00000100:00100000:3.0:1783969322.501379:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280548992 00000100:00100000:3.0:1783969322.501405:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783969322.501411:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+16:5790:x1870627280548992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969322.501675:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+16:5790:x1870627280548992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969322.501681:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783969322.502327:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280548992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969322.502362:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280549120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969322.502407:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969322.502470:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b5013e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783969322.502501:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280549120 00000100:00100000:3.0:1783969322.502506:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280549120 00000100:00100000:3.0:1783969322.502571:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783969322.502578:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+16:5790:x1870627280549120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969322.502912:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+16:5790:x1870627280549120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 333us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969322.502919:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1783969322.503061:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280549120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783969322.503374:0:8320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a80000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8320:1870627280549248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969322.503408:0:8320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969322.503470:0:8320:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b5224480 going to sleep for 11 seconds 00000100:00100000:2.0:1783969322.503503:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280549248 00000100:00100000:2.0:1783969322.503507:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280549248 00000100:00100000:2.0:1783969322.503570:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783969322.503578:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+16:8320:x1870627280549248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783969322.503852:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+16:8320:x1870627280549248:12345-0@lo:502:llog_process_th.0 Request processed in 274us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969322.503912:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1783969322.504068:0:8320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a80000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8320:1870627280549248:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783969322.504097:0:8320:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969322.504106:0:8320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969322.504108:0:8320:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783969322.504112:0:8320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783969322.504130:0:8320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8320:1870627280549376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969322.504159:0:8320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969322.504211:0:8320:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b5013e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783969322.504241:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280549376 00000100:00100000:2.0:1783969322.504245:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280549376 00000100:00100000:3.0:1783969322.504326:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1783969322.504334:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+16:8320:x1870627280549376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969322.504491:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+16:8320:x1870627280549376:12345-0@lo:502:llog_process_th.0 Request processed in 157us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969322.504498:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783969322.504572:0:8320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8320:1870627280549376:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783969322.504589:0:8320:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969322.504594:0:8320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969322.504595:0:8320:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783969322.504598:0:8320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1783969322.504800:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1783969322.504817:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783969322.504826:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faad56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad5d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969322.504837:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faad56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad5d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969322.504848:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783969322.504851:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ac783021000 from 39 10000000:01000000:2.0:1783969322.504854:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783969322.504943:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2800/0xbacf56d076faad64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969322.504952:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2800/0xbacf56d076faad64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969322.504961:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2800/0xbacf56d076faad64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969322.504974:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280549504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783969322.505013:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969322.505132:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac78385c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969322.505179:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280549504 00000100:00100000:3.0:1783969322.505184:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280549504 00000100:00100000:3.0:1783969322.505219:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783969322.505225:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+16:5790:x1870627280549504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969322.505235:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969322.505247:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac783de6600/0xbacf56d076faad6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faad64 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969322.505270:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac783de6600/0xbacf56d076faad6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faad64 expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969322.505287:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac783de6600/0xbacf56d076faad6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faad64 expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969322.505296:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de6600, rc 0) 00000100:00100000:3.0:1783969322.505398:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280549504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969322.505404:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783969322.505478:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280549504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969322.505490:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2800/0xbacf56d076faad64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad6b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969322.505499:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2800/0xbacf56d076faad64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faad6b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969322.505557:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280549632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969322.505581:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969322.505629:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac78385c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969322.505661:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280549632 00000100:00100000:1.0:1783969322.505665:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280549632 00000100:00100000:1.0:1783969322.506091:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783969322.506100:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280549632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969322.506359:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280549632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969322.506365:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783969322.506433:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280549632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969322.506466:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280549760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969322.506504:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969322.506571:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac78385c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969322.506600:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280549760 00000100:00100000:1.0:1783969322.506604:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280549760 00000100:00100000:1.0:1783969322.506661:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783969322.506667:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280549760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969322.506820:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280549760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969322.506826:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783969322.506931:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280549760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969322.507138:0:8321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8321:1870627280549888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783969322.507175:0:8321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969322.513825:0:8321:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac78385c840 going to sleep for 11 seconds 00000100:00100000:3.0:1783969322.514113:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280549888 00000100:00100000:3.0:1783969322.514123:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280549888 00000100:00100000:3.0:1783969322.514178:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783969322.514187:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+17:8321:x1870627280549888:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969322.514468:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+17:8321:x1870627280549888:12345-0@lo:502:llog_process_th.0 Request processed in 282us (7292us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969322.514476:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783969322.514632:0:8321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8321:1870627280549888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783969322.514708:0:8321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8321:1870627280550016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783969322.514752:0:8321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969322.514777:0:8321:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b2fea9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969322.514829:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280550016 00000100:00100000:1.0:1783969322.514839:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280550016 00000100:00100000:1.0:1783969322.514887:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783969322.514894:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+17:8321:x1870627280550016:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969322.515041:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+17:8321:x1870627280550016:12345-0@lo:502:llog_process_th.0 Request processed in 147us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969322.515049:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1783969322.516638:0:8321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8321:1870627280550016:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783969322.516676:0:8321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1783969322.516854:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1783969322.516890:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783969322.516900:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2800/0xbacf56d076faad64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad6b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969322.516911:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2800/0xbacf56d076faad64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad6b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969322.516920:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1783969322.516922:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1783969322.516925:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783969322.516959:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faad72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969322.516968:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faad72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969322.516977:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faad72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969322.516994:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280550144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783969322.517040:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969322.517070:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b5013900 going to sleep for 11 seconds 00000100:00100000:2.0:1783969322.517129:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280550144 00000100:00100000:2.0:1783969322.517135:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280550144 00000100:00100000:2.0:1783969322.517161:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783969322.517168:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280550144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969322.517178:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969322.517189:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7c21e2000/0xbacf56d076faad79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faad72 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969322.517210:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7c21e2000/0xbacf56d076faad79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faad72 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969322.517219:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7c21e2000/0xbacf56d076faad79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faad72 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969322.517227:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c21e2000, rc 0) 00000100:00100000:2.0:1783969322.517265:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280550144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969322.517270:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783969322.517810:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280550144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783969322.517824:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faad72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad79 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969322.517834:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faad72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faad79 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969322.517912:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280550272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969322.517940:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969322.517965:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b5013900 going to sleep for 11 seconds 00000100:00100000:2.0:1783969322.518022:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280550272 00000100:00100000:2.0:1783969322.518026:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280550272 00000100:00100000:2.0:1783969322.518058:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783969322.518065:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280550272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969322.518270:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280550272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969322.518277:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783969322.518375:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280550272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969322.518399:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280550400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969322.518432:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969322.518456:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b5013900 going to sleep for 11 seconds 00000100:00100000:1.0:1783969322.518468:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280550400 00000100:00100000:1.0:1783969322.518471:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280550400 00000100:00100000:1.0:1783969322.518489:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1783969322.518494:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280550400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969322.518633:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280550400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969322.518640:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783969322.518718:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280550400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783969322.520730:0:8322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a80000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8322:1870627280550528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969322.520808:0:8322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969322.520904:0:8322:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b52249c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969322.521110:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280550528 00000100:00100000:1.0:1783969322.521117:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280550528 00000100:00100000:1.0:1783969322.521201:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1783969322.521211:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+18:8322:x1870627280550528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969322.521465:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+18:8322:x1870627280550528:12345-0@lo:502:llog_process_th.0 Request processed in 256us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969322.521479:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783969322.521562:0:8322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a80000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8322:1870627280550528:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783969322.521590:0:8322:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969322.521598:0:8322:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969322.521601:0:8322:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783969322.521606:0:8322:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783969322.521627:0:8322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a80000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8322:1870627280550656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969322.521661:0:8322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969322.521984:0:8322:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b52249c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969322.522086:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280550656 00000100:00100000:2.0:1783969322.522099:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280550656 00000100:00100000:2.0:1783969322.522125:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783969322.522133:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+18:8322:x1870627280550656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783969322.522334:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+18:8322:x1870627280550656:12345-0@lo:502:llog_process_th.0 Request processed in 201us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969322.522341:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783969322.522479:0:8322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a80000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8322:1870627280550656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783969322.522501:0:8322:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969322.522507:0:8322:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969322.522508:0:8322:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783969322.522512:0:8322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1783969322.522780:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1783969322.522798:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783969322.522807:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faad72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad79 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969322.522817:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faad72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad79 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969322.522826:0:5790:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783969322.522829:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9ac7917f19c0 from 1 10000000:01000000:2.0:1783969322.522831:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783969322.522896:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3600/0xbacf56d076faad80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969322.522905:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3600/0xbacf56d076faad80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969322.522915:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3600/0xbacf56d076faad80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969322.522933:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280550784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783969322.522971:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969322.522996:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac785355d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783969322.523060:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280550784 00000100:00100000:0.0:1783969322.523065:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280550784 00000100:00100000:0.0:1783969322.523089:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783969322.523096:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280550784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969322.523106:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969322.523119:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7bfb92800/0xbacf56d076faad87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faad80 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969322.523141:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7bfb92800/0xbacf56d076faad87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faad80 expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969322.523151:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7bfb92800/0xbacf56d076faad87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faad80 expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969322.523160:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92800, rc 0) 00000100:00100000:0.0:1783969322.523215:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+19:5790:x1870627280550784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969322.523230:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783969322.523394:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280550784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969322.523407:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3600/0xbacf56d076faad80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad87 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969322.523416:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3600/0xbacf56d076faad80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faad87 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969322.523463:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280550912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969322.523488:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969322.523508:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac785355d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783969322.523543:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280550912 00000100:00100000:0.0:1783969322.523547:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280550912 00000100:00100000:0.0:1783969322.523566:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783969322.523572:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+19:5790:x1870627280550912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969322.524046:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+19:5790:x1870627280550912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 472us (555us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783969322.524060:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783969322.524124:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280550912:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1783969322.524148:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783969322.524154:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3600/0xbacf56d076faad80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad87 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969322.524163:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3600/0xbacf56d076faad80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad87 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969322.533143:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969322.551288:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969322.551379:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969322.551413:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969322.551445:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969322.551611:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272135168 00000100:00100000:2.0:1783969322.551621:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272135168 00000100:00100000:2.0:1783969322.551699:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272135040 00000100:00100000:2.0:1783969322.551704:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272135040 00000100:00100000:2.0:1783969322.551725:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:2.0:1783969322.551735:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+5:2348:x1870627272135168:12345-192.168.203.39@tcp:400: 00000100:00080000:3.0:1783969322.551767:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783969322.551772:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969322.551890:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272134912 00000100:00100000:1.0:1783969322.551895:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272134912 00000100:00100000:1.0:1783969322.551935:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 26 00000100:00100000:1.0:1783969322.551942:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+6:2348:x1870627272134912:12345-192.168.203.39@tcp:400: 00000100:00100000:2.0:1783969322.552275:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+5:2348:x1870627272135168:12345-192.168.203.39@tcp:400: Request processed in 540us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969322.552283:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:2.0:1783969322.552315:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:2.0:1783969322.552321:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+5:2348:x1870627272135040:12345-192.168.203.39@tcp:400: 00000100:00100000:1.0:1783969322.552573:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+6:2348:x1870627272134912:12345-192.168.203.39@tcp:400: Request processed in 629us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969322.552580:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 26 00000100:00080000:1.0:1783969322.552602:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969322.552641:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+5:2348:x1870627272135040:12345-192.168.203.39@tcp:400: Request processed in 319us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969322.552648:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:0.0:1783969322.552938:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272134784 00000100:00100000:0.0:1783969322.552945:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272134784 00000100:00100000:0.0:1783969322.552976:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 161 00000100:00100000:0.0:1783969322.552983:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+8:2349:x1870627272134784:12345-192.168.203.39@tcp:400: 00000100:00100000:0.0:1783969322.553082:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+8:2349:x1870627272134784:12345-192.168.203.39@tcp:400: Request processed in 98us (1802us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969322.553090:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 161 00000100:00100000:3.0:1783969322.742790:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969322.743738:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272135296 00000100:00100000:2.0:1783969322.743750:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272135296 00000100:00100000:2.0:1783969322.743818:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 162 00000100:00100000:2.0:1783969322.743828:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+8:5581:x1870627272135296:12345-192.168.203.39@tcp:101: 00010000:00010000:2.0:1783969322.743844:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969322.743892:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7c21e2200/0xbacf56d076faad8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63038 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969322.743920:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7c21e2200/0xbacf56d076faad8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63038 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969322.743932:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7c21e2200/0xbacf56d076faad8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63038 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969322.743941:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c21e2200, rc 0) 00000100:00100000:2.0:1783969322.744014:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+9:5581:x1870627272135296:12345-192.168.203.39@tcp:101: Request processed in 187us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969322.744022:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 162 00000100:00100000:2.0:1783969322.746043:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969322.746286:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272135424 00000100:00100000:1.0:1783969322.746294:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272135424 00000100:00100000:1.0:1783969322.746344:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 163 00000100:00100000:1.0:1783969322.746354:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+9:5581:x1870627272135424:12345-192.168.203.39@tcp:501: 00000100:00100000:1.0:1783969322.746644:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+9:5581:x1870627272135424:12345-192.168.203.39@tcp:501: Request processed in 291us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969322.746651:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 163 00000100:00100000:3.0:1783969322.752280:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969322.752474:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272135552 00000100:00100000:0.0:1783969322.752483:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272135552 00000100:00100000:0.0:1783969322.752542:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 164 00000100:00100000:0.0:1783969322.752552:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+9:5581:x1870627272135552:12345-192.168.203.39@tcp:503: 00000100:00100000:0.0:1783969322.752777:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+9:5581:x1870627272135552:12345-192.168.203.39@tcp:503: Request processed in 226us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969322.752785:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 164 00000100:00100000:3.0:1783969322.758567:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969322.758720:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272135680 00000100:00100000:2.0:1783969322.758731:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272135680 00000100:00100000:2.0:1783969322.758794:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 165 00000100:00100000:2.0:1783969322.758804:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+9:6053:x1870627272135680:12345-192.168.203.39@tcp:502: 00000100:00100000:2.0:1783969322.759267:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+9:6053:x1870627272135680:12345-192.168.203.39@tcp:502: Request processed in 463us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969322.759290:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 165 00000100:00100000:2.0:1783969322.779653:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969322.779762:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272135808 00000100:00100000:1.0:1783969322.779771:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272135808 00000100:00100000:1.0:1783969322.779831:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 166 00000100:00100000:1.0:1783969322.779840:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+9:6053:x1870627272135808:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783969322.780446:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+9:6053:x1870627272135808:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 604us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969322.780456:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 166 00000100:00100000:3.0:1783969322.790632:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969322.798136:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272135936 00000100:00100000:0.0:1783969322.798152:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272135936 00000100:00100000:0.0:1783969322.798289:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 167 00000100:00100000:0.0:1783969322.798300:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+9:5581:x1870627272135936:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969322.798314:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969322.798426:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7bfb92000/0xbacf56d076faad95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6303f expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969322.798455:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7bfb92000/0xbacf56d076faad95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6303f expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969322.798486:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7bfb92000/0xbacf56d076faad95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6303f expref: 10 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969322.798494:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92000, rc 0) 00000100:00100000:0.0:1783969322.798623:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:5581:x1870627272135936:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 Request processed in 325us (8000us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969322.798630:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 167 00000100:00100000:3.0:1783969322.807159:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969322.807296:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272136064 00000100:00100000:2.0:1783969322.807305:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272136064 00000100:00100000:2.0:1783969322.807458:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 168 00000100:00100000:2.0:1783969322.807469:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:5581:x1870627272136064:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969322.807791:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:5581:x1870627272136064:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 Request processed in 323us (1234us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783969322.807801:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 168 00010000:00010000:1.0:1783969323.558805:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969323.641912:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280551040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783969323.641989:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969323.642067:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280551040 00000100:00100000:0.0:1783969323.642074:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280551040 00000100:00100000:0.0:1783969323.642127:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783969323.642136:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280551040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783969323.642170:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1783969323.642201:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783969323.642212:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280551040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969323.642220:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1783969323.642250:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7a7a80000 x1870627280551040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969323.642268:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280551040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969324.135317:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280551168:0@lo:400:kworker.0 00000100:00100000:1.0:1783969324.135387:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969324.135444:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7aea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1870627280551680:0@lo:400:kworker.0 00000100:00100000:1.0:1783969324.135474:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969324.135501:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783969324.135507:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280551552:0@lo:400:kworker.0 00000100:00100000:1.0:1783969324.135530:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969324.135559:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7aeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1870627280551296:0@lo:400:kworker.0 00000100:00100000:1.0:1783969324.135580:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969324.135595:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280551808:0@lo:400:kworker.0 00000100:00100000:1.0:1783969324.135613:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969324.135631:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969324.135636:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280551424:0@lo:400:kworker.0 00000100:00100000:1.0:1783969324.135653:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969324.135691:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280551680 00000100:00100000:3.0:1783969324.137148:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280551296 00000100:00100000:3.0:1783969324.137172:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280551296 00000100:00100000:3.0:1783969324.137227:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280551424 00000100:00100000:3.0:1783969324.137230:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280551424 00000100:00100000:3.0:1783969324.137255:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783969324.137265:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1870627280551296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969324.137343:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1870627280551296:12345-0@lo:400:kworker.0 Request processed in 79us (1761us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969324.137350:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783969324.137366:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783969324.137373:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280551424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969324.137399:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280551424:12345-0@lo:400:kworker.0 Request processed in 26us (1744us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969324.137405:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1783969324.137423:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969324.137455:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280551424:0@lo:400:kworker.0 00000100:00100000:3.0:1783969324.137469:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7aeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1870627280551296:0@lo:400:kworker.0 00000100:00100000:1.0:1783969324.138098:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280551680 00000100:00100000:1.0:1783969324.138145:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783969324.138152:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870627280551680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969324.138201:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870627280551680:12345-0@lo:400:kworker.0 Request processed in 50us (2725us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969324.138207:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783969324.138226:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280551552 00000100:00100000:1.0:1783969324.138237:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280551552 00000100:00100000:1.0:1783969324.138262:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280551808 00000100:00100000:1.0:1783969324.138265:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280551808 00000100:00100000:1.0:1783969324.138279:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783969324.138284:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280551552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969324.138319:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280551552:12345-0@lo:400:kworker.0 Request processed in 34us (2788us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969324.138325:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783969324.138335:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783969324.138340:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280551808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969324.138371:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280551808:12345-0@lo:400:kworker.0 Request processed in 31us (2757us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969324.138377:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1783969324.138397:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783969324.138400:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783969324.138422:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7a7aeb480 x1870627280551552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969324.138435:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280551552:0@lo:400:kworker.0 00000100:00100000:1.0:1783969324.138446:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7aea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1870627280551680:0@lo:400:kworker.0 00010000:00080000:1.0:1783969324.138476:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7a7aebb80 x1870627280551808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969324.138485:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7aebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280551808:0@lo:400:kworker.0 00000100:00100000:0.0:1783969324.140318:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280551168 00000100:00100000:0.0:1783969324.140330:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280551168 00000100:00100000:0.0:1783969324.140388:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1783969324.140398:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3288:x1870627280551168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969324.140578:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280551168:0@lo:400:kworker.0 00000100:00100000:0.0:1783969324.140855:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3288:x1870627280551168:12345-0@lo:400:kworker.0 Request processed in 457us (5465us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969324.140888:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000020:00000080:3.0:1783969324.518564:0:8359:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe91e3d670 20000000:00000080:3.0:1783969324.518581:0:8359:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ac7ba143000 uarg=0000000000000000 20000000:01000000:3.0:1783969324.518615:0:8359:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783969324.518621:0:8359:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783969324.518626:0:8359:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783969324.519625:0:8360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1783969324.519797:0:8359:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1783969324.524672:0:8359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1783969324.524748:0:8359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1783969324.524806:0:8359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1783969324.524825:0:8359:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783969324.524844:0:8359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faad9c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969324.525270:0:8359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac781496000/0xbacf56d076faab65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faab5e expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969324.525280:0:8359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac7c21e3e00/0xbacf56d076faabe3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faabd5 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969324.525287:0:8359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac780030c00/0xbacf56d076faac3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faac37 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969324.525297:0:8359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac781496c00/0xbacf56d076faacfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63007 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969324.525314:0:8359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faad9c lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969324.525354:0:8359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac781496c00/0xbacf56d076faacfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63007 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969324.525369:0:8359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac781496c00/0xbacf56d076faacfb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63007 expref: 9 pid: 5787 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969324.525383:0:8359:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8359:1870627280551936:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969324.525591:0:8359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac780030c00/0xbacf56d076faac3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faac37 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969324.525600:0:8359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac780030c00/0xbacf56d076faac3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faac37 expref: 18 pid: 5788 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969324.525610:0:8359:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8359:1870627280552064:0@lo:104: 00000100:00100000:2.0:1783969324.525649:0:8359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783969324.525698:0:8359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac7c21e3e00/0xbacf56d076faabe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faabd5 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969324.525708:0:8359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac7c21e3e00/0xbacf56d076faabe3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faabd5 expref: 18 pid: 5786 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969324.525716:0:8359:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8359:1870627280552192:0@lo:104: 00000100:00100000:2.0:1783969324.525740:0:8359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783969324.525773:0:8359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac781496000/0xbacf56d076faab65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faab5e expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969324.525790:0:8359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac781496000/0xbacf56d076faab65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faab5e expref: 18 pid: 5787 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969324.525799:0:8359:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8359:1870627280552320:0@lo:104: 00000100:00100000:2.0:1783969324.525820:0:8359:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac791933780 going to sleep for 11 seconds 00000100:00100000:1.0:1783969324.525904:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783969324.525923:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969324.525953:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280552064 00000100:00100000:1.0:1783969324.525960:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280552064 00000100:00100000:1.0:1783969324.526008:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280552192 00000100:00100000:1.0:1783969324.526012:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280552192 00000100:00100000:1.0:1783969324.526022:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280552320 00000100:00100000:1.0:1783969324.526025:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280552320 00000100:00100000:1.0:1783969324.526038:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783969324.526046:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+5:8359:x1870627280552064:12345-0@lo:104: 00010000:00010000:1.0:1783969324.526057:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faac37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faac3e expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969324.526105:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783969324.526111:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+5:8359:x1870627280552064:12345-0@lo:104: Request processed in 67us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969324.526118:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783969324.526133:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783969324.526139:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1701050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+4:8359:x1870627280552192:12345-0@lo:104: 00010000:00010000:1.0:1783969324.526146:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faabd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faabe3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969324.526177:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783969324.526181:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1701050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+4:8359:x1870627280552192:12345-0@lo:104: Request processed in 43us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969324.526187:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783969324.526216:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783969324.526223:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+3:8359:x1870627280552320:12345-0@lo:104: 00010000:00010000:1.0:1783969324.526230:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac780031800/0xbacf56d076faab5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faab65 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969324.526275:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783969324.526280:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+3:8359:x1870627280552320:12345-0@lo:104: Request processed in 59us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969324.526286:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1783969324.526302:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783969324.526307:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faac37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faac3e expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969324.526314:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6800 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:1.0:1783969324.526318:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faac37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faac3e expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969324.526328:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faac37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faac3e expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783969324.526335:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faac37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faac3e expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969324.526341:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783969324.526366:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faac37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faac3e expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969324.526373:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783969324.526391:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faac37 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faac3e expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969324.526398:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac783de6800/0xbacf56d076faac37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faac3e expref: -99 pid: 7477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969324.526421:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783969324.526423:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faabd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faabe3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969324.526429:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c21e3a00 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:1.0:1783969324.526432:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faabd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faabe3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969324.526438:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faabd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faabe3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783969324.526444:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faabd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faabe3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969324.526449:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783969324.526463:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faabd5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faabe3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969324.526483:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783969324.526498:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faabd5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faabe3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969324.526504:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faabd5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faabe3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969324.526514:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969324.526517:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac780031800/0xbacf56d076faab5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faab65 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969324.526533:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac780031800 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:1.0:1783969324.526535:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac780031800/0xbacf56d076faab5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faab65 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969324.526543:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac780031800/0xbacf56d076faab5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faab65 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783969324.526548:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac780031800/0xbacf56d076faab5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faab65 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969324.526553:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783969324.526567:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac780031800/0xbacf56d076faab5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faab65 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969324.526573:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783969324.526579:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac780031800/0xbacf56d076faab5e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faab65 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969324.526586:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac780031800/0xbacf56d076faab5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faab65 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969324.526599:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969324.526601:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969324.526603:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969324.526617:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969324.526629:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280552448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783969324.526657:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969324.526702:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280552576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783969324.526735:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969324.526752:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969324.526757:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280552704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783969324.526776:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969324.527055:0:8359:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8359:1870627280552064:0@lo:104: 00000100:00100000:2.0:1783969324.527064:0:8359:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8359:1870627280552192:0@lo:104: 00000100:00100000:2.0:1783969324.527071:0:8359:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8359:1870627280552320:0@lo:104: 00010000:00010000:0.0:1783969324.527181:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969324.527186:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969324.527195:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280552448 00000100:00100000:0.0:1783969324.527199:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280552448 00010000:00010000:0.0:1783969324.527220:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac780030c00/0xbacf56d076faac3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faac37 expref: 19 pid: 5788 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969324.527236:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280552576 00000100:00100000:0.0:1783969324.527238:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280552576 00010000:00010000:0.0:1783969324.527247:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac7c21e3e00/0xbacf56d076faabe3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faabd5 expref: 20 pid: 5786 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969324.527255:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280552704 00000100:00100000:0.0:1783969324.527256:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280552704 00010000:00010000:0.0:1783969324.527264:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac781496000/0xbacf56d076faab65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faab5e expref: 21 pid: 5787 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969324.527273:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783969324.527278:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c893ad09-f78f-4711-bea5-6489668294ed+21:3285:x1870627280552448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783969324.527287:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969324.527291:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac780030c00/0xbacf56d076faac3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faac37 expref: 21 pid: 5788 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969324.527300:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac780030c00/0xbacf56d076faac3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faac37 expref: 21 pid: 5788 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969324.527312:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac780030c00/0xbacf56d076faac3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faac37 expref: 21 pid: 5788 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969324.527323:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969324.527360:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c893ad09-f78f-4711-bea5-6489668294ed+20:3285:x1870627280552448:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969324.527374:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783969324.527387:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783969324.527392:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c893ad09-f78f-4711-bea5-6489668294ed+19:3287:x1870627280552576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783969324.527399:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969324.527403:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac7c21e3e00/0xbacf56d076faabe3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faabd5 expref: 19 pid: 5786 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969324.527410:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac7c21e3e00/0xbacf56d076faabe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faabd5 expref: 19 pid: 5786 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969324.527419:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7c21e3e00/0xbacf56d076faabe3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faabd5 expref: 19 pid: 5786 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969324.527427:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969324.527450:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c893ad09-f78f-4711-bea5-6489668294ed+18:3287:x1870627280552576:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969324.527455:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783969324.527477:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783969324.527483:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c893ad09-f78f-4711-bea5-6489668294ed+17:3287:x1870627280552704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783969324.527490:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969324.527494:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac781496000/0xbacf56d076faab65 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faab5e expref: 17 pid: 5787 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969324.527501:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac781496000/0xbacf56d076faab65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faab5e expref: 17 pid: 5787 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969324.527510:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac781496000/0xbacf56d076faab65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faab5e expref: 17 pid: 5787 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969324.527527:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969324.527547:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c893ad09-f78f-4711-bea5-6489668294ed+16:3287:x1870627280552704:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969324.527553:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783969324.527575:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280552704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783969324.527581:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280552576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783969324.527733:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280552448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783969324.533544:0:8359:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8359:1870627280551936:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969324.533577:0:8359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faad9c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969324.534320:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969324.534543:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272136192 00000100:00100000:0.0:1783969324.534550:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272136192 00010000:00010000:0.0:1783969324.534586:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac781496c00/0xbacf56d076faacfb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63007 expref: 10 pid: 5787 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969324.534666:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 24 00000100:00100000:0.0:1783969324.534687:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1531180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:2350:x1870627272136192:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969324.534702:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969324.534716:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac781496c00/0xbacf56d076faacfb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63007 expref: 10 pid: 5787 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969324.534730:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac781496c00/0xbacf56d076faacfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63007 expref: 10 pid: 5787 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969324.534747:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac781496c00/0xbacf56d076faacfb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63007 expref: 10 pid: 5787 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969324.534765:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faad9c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969324.534774:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faad9c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969324.534803:0:5780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faad9c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969324.534811:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faad9c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969324.534817:0:5780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faad9c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969324.534824:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faad9c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969324.534830:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c21e2c00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969324.534835:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faad9c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969324.534843:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faad9c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969324.534889:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faad9c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969324.534899:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969324.534941:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1531180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+9:2350:x1870627272136192:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 266us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969324.534948:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 24 00010000:00010000:2.0:1783969324.535013:0:8359:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faad9c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969324.535021:0:8359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faad9c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969324.535027:0:8359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faad9c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969324.584215:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969324.656293:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280552832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969324.656364:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969324.656521:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280552832 00000100:00100000:2.0:1783969324.656529:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280552832 00000100:00100000:2.0:1783969324.656580:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783969324.656589:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280552832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783969324.656637:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783969324.656699:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280552832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969324.656707:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1783969324.656779:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac681f4df80 x1870627280552832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969324.656799:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280552832:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783969325.605452:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969325.940751:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969325.943426:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272136320 00000100:00100000:2.0:1783969325.943441:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272136320 00000100:00100000:2.0:1783969325.943650:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 170 00000100:00100000:2.0:1783969325.943662:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+9:5581:x1870627272136320:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969325.943689:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969325.943708:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7c21e3a00/0xbacf56d076faada3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63046 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969325.943738:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7c21e3a00/0xbacf56d076faada3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63046 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969325.943748:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7c21e3a00/0xbacf56d076faada3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63046 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969325.943757:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c21e3a00, rc 0) 00000100:00100000:2.0:1783969325.943815:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:5581:x1870627272136320:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 Request processed in 156us (3070us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969325.943822:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 170 00000100:00100000:2.0:1783969325.950700:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969325.950822:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272136448 00000100:00100000:2.0:1783969325.950830:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272136448 00000100:00100000:2.0:1783969325.950892:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 171 00000100:00100000:2.0:1783969325.950902:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:5581:x1870627272136448:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969325.951149:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:5581:x1870627272136448:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 Request processed in 249us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969325.951157:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 171 00000100:00100000:3.0:1783969325.955345:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969325.957460:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272136576 00000100:00100000:0.0:1783969325.957473:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272136576 00000100:00100000:0.0:1783969325.957533:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 172 00000100:00100000:0.0:1783969325.957553:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:5581:x1870627272136576:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783969325.957761:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:5581:x1870627272136576:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 Request processed in 210us (2424us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969325.957769:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 172 00000100:00100000:2.0:1783969325.961068:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969325.961103:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272136704 00000100:00100000:2.0:1783969325.961111:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272136704 00000100:00100000:2.0:1783969325.961167:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 173 00000100:00100000:2.0:1783969325.961177:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:6117:x1870627272136704:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783969325.961393:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:6117:x1870627272136704:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 217us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969325.961401:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 173 00000100:00100000:2.0:1783969325.970366:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969325.973012:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272136832 00000100:00100000:3.0:1783969325.973025:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272136832 00000100:00100000:0.0:1783969325.974172:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 174 00000100:00100000:0.0:1783969325.974183:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:6117:x1870627272136832:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783969325.974697:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:6117:x1870627272136832:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 514us (4338us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969325.974706:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 174 10000000:01000000:1.0:1783969326.181237:0:5790:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783969326.181246:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ac7bf7a8800 from 4 10000000:01000000:1.0:1783969326.181250:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783969326.181299:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781496800/0xbacf56d076faadaa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969326.181312:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac781496800/0xbacf56d076faadaa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969326.181322:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac781496800/0xbacf56d076faadaa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969326.181347:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280552960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783969326.181418:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969326.181467:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfda63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969326.181614:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280552960 00000100:00100000:3.0:1783969326.181622:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280552960 00000100:00100000:3.0:1783969326.181697:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1783969326.181706:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+16:5790:x1870627280552960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969326.181719:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969326.181732:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac783de6800/0xbacf56d076faadb1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faadaa expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969326.181755:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac783de6800/0xbacf56d076faadb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faadaa expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969326.181767:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac783de6800/0xbacf56d076faadb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faadaa expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969326.181775:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de6800, rc 0) 00000100:00100000:3.0:1783969326.181816:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280552960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969326.181822:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1783969326.181890:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280552960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969326.181904:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac781496800/0xbacf56d076faadaa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faadb1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969326.181914:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac781496800/0xbacf56d076faadaa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faadb1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969326.181969:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1530a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280553088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969326.182005:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969326.182020:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac791fb20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969326.182031:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280553088 00000100:00100000:3.0:1783969326.182035:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280553088 00000100:00100000:3.0:1783969326.182055:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783969326.182061:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280553088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969326.182314:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280553088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969326.182321:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783969326.182351:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1530a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280553088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969326.182375:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1530a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280553216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969326.182407:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969326.182420:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac788736240 going to sleep for 11 seconds 00000100:00100000:3.0:1783969326.182429:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280553216 00000100:00100000:3.0:1783969326.182432:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280553216 00000100:00100000:3.0:1783969326.182452:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1783969326.182457:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280553216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969326.182594:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280553216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969326.182600:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1783969326.182694:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1530a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280553216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783969326.187477:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7ae8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8430:1870627280553344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969326.187564:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969326.187650:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b5224000 going to sleep for 11 seconds 00000100:00100000:3.0:1783969326.187697:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280553344 00000100:00100000:3.0:1783969326.187703:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280553344 00000100:00100000:3.0:1783969326.187820:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1783969326.187830:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+17:8430:x1870627280553344:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969326.201892:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7ae8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8430:1870627280553344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969326.201914:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+17:8430:x1870627280553344:12345-0@lo:502:llog_process_th.0 Request processed in 14081us (14346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969326.201939:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000020:01000000:0.0:1783969326.202086:0:8430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969326.202096:0:8430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969326.202098:0:8430:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783969326.202105:0:8430:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac7bf7a8800 00000020:00000080:0.0:1783969326.202107:0:8430:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783969326.203291:0:8430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7ae9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8430:1870627280553472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969326.203361:0:8430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969326.203393:0:8430:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b5224480 going to sleep for 11 seconds 00000100:00100000:2.0:1783969326.210398:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280553472 00000100:00100000:2.0:1783969326.210413:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280553472 00000100:00100000:2.0:1783969326.210485:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1783969326.210495:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+17:8430:x1870627280553472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783969326.210768:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+17:8430:x1870627280553472:12345-0@lo:502:llog_process_th.0 Request processed in 275us (7406us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969326.210776:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1783969326.211327:0:8430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7ae9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8430:1870627280553472:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783969326.211361:0:8430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969326.211369:0:8430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969326.211377:0:8430:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783969326.211382:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783969326.225761:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1783969326.225794:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783969326.225805:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781496800/0xbacf56d076faadaa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faadb1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969326.225818:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac781496800/0xbacf56d076faadaa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faadb1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969326.225828:0:5790:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783969326.225831:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ac7ba5f7000 from 4 10000000:01000000:3.0:1783969326.225834:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783969326.225988:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de7600/0xbacf56d076faadb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969326.225997:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac783de7600/0xbacf56d076faadb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969326.226008:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac783de7600/0xbacf56d076faadb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969326.226031:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1533800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280553600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783969326.226093:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969326.239247:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac788736780 going to sleep for 11 seconds 00000100:00100000:3.0:1783969326.239288:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280553600 00000100:00100000:3.0:1783969326.239296:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280553600 00000100:00100000:3.0:1783969326.239356:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1783969326.239365:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280553600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969326.239379:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969326.239404:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac783de7a00/0xbacf56d076faadbf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faadb8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969326.239432:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac783de7a00/0xbacf56d076faadbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faadb8 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969326.239442:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac783de7a00/0xbacf56d076faadbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faadb8 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969326.239451:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7a00, rc 0) 00000100:00100000:3.0:1783969326.239523:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280553600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (13429us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969326.239529:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1783969326.239580:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1533800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280553600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969326.239596:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac783de7600/0xbacf56d076faadb8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faadbf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969326.239605:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac783de7600/0xbacf56d076faadb8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faadbf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969326.239677:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1533800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280553728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969326.239709:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969326.239729:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac788736780 going to sleep for 11 seconds 00000100:00100000:3.0:1783969326.239739:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280553728 00000100:00100000:3.0:1783969326.239742:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280553728 00000100:00100000:3.0:1783969326.239761:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1783969326.239766:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280553728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969326.240006:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280553728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969326.240018:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1783969326.240050:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1533800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280553728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969326.240076:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1533800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280553856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969326.240112:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969326.240141:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac788736780 going to sleep for 11 seconds 00000100:00100000:3.0:1783969326.240153:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280553856 00000100:00100000:3.0:1783969326.240156:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280553856 00000100:00100000:3.0:1783969326.240176:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1783969326.240181:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280553856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969326.240311:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280553856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969326.240318:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1783969326.240357:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1533800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280553856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969326.240520:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1533800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8435:1870627280553984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969326.240554:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969326.240571:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280553984 00000100:00100000:3.0:1783969326.240575:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280553984 00000100:00100000:3.0:1783969326.240594:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1783969326.240600:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+18:8435:x1870627280553984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969326.240731:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+18:8435:x1870627280553984:12345-0@lo:502:llog_process_th.0 Request processed in 130us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969326.240737:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1783969326.240766:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac788736600 going to sleep for 11 seconds 00000100:00100000:3.0:1783969326.240778:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1533800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8435:1870627280553984:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783969326.240806:0:8435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969326.240814:0:8435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969326.240816:0:8435:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783969326.240824:0:8435:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac7ba5f7000 00000020:00000080:3.0:1783969326.240827:0:8435:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783969326.240912:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1533800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8435:1870627280554112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969326.240944:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969326.240964:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280554112 00000100:00100000:3.0:1783969326.240967:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280554112 00000100:00100000:3.0:1783969326.240986:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1783969326.240991:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+18:8435:x1870627280554112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969326.241096:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+18:8435:x1870627280554112:12345-0@lo:502:llog_process_th.0 Request processed in 104us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969326.241103:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1783969326.241130:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac788736600 going to sleep for 11 seconds 00000100:00100000:3.0:1783969326.241142:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1533800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8435:1870627280554112:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783969326.241159:0:8435:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969326.241163:0:8435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969326.241164:0:8435:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1783969326.241168:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783969326.241211:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1783969326.241224:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783969326.241233:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de7600/0xbacf56d076faadb8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faadbf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969326.241242:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac783de7600/0xbacf56d076faadb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faadbf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969326.241260:0:5790:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783969326.241262:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ac783021000 from 4 10000000:01000000:3.0:1783969326.241264:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783969326.241283:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de7800/0xbacf56d076faadc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969326.241289:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac783de7800/0xbacf56d076faadc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969326.241296:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac783de7800/0xbacf56d076faadc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969326.241308:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1533800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280554240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783969326.241331:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969326.241343:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac788736600 going to sleep for 11 seconds 00000100:00100000:3.0:1783969326.241353:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280554240 00000100:00100000:3.0:1783969326.241356:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280554240 00000100:00100000:3.0:1783969326.241374:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1783969326.241379:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280554240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969326.241387:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969326.241398:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac783de6000/0xbacf56d076faadcd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faadc6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969326.241414:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac783de6000/0xbacf56d076faadcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faadc6 expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969326.241421:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac783de6000/0xbacf56d076faadcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faadc6 expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969326.241437:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de6000, rc 0) 00000100:00100000:3.0:1783969326.241465:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:5790:x1870627280554240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969326.241470:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1783969326.241495:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1533800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280554240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969326.241505:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac783de7800/0xbacf56d076faadc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faadcd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969326.241512:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac783de7800/0xbacf56d076faadc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faadcd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969326.241544:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1533800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280554368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969326.241566:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969326.241579:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac788736600 going to sleep for 11 seconds 00000100:00100000:3.0:1783969326.241589:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280554368 00000100:00100000:3.0:1783969326.241592:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280554368 00000100:00100000:3.0:1783969326.241608:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1783969326.241613:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:5790:x1870627280554368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969326.241782:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:5790:x1870627280554368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969326.241789:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1783969326.241817:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1533800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280554368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969326.241840:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1533800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280554496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969326.241894:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969326.241912:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac788736600 going to sleep for 11 seconds 00000100:00100000:3.0:1783969326.241923:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280554496 00000100:00100000:3.0:1783969326.241926:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280554496 00000100:00100000:3.0:1783969326.241945:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1783969326.241951:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:5790:x1870627280554496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969326.242070:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:5790:x1870627280554496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969326.242076:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1783969326.242110:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1533800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280554496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969326.251013:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1533800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8436:1870627280554624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969326.251102:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969326.252253:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7a02dd540 going to sleep for 11 seconds 00000100:00100000:0.0:1783969326.257680:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280554624 00000100:00100000:0.0:1783969326.257692:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280554624 00000100:00100000:0.0:1783969326.257747:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1783969326.257757:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:8436:x1870627280554624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969326.258015:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:8436:x1870627280554624:12345-0@lo:502:llog_process_th.0 Request processed in 259us (6912us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969326.258023:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1783969326.258094:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1533800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8436:1870627280554624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783969326.258374:0:8436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969326.258384:0:8436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969326.258387:0:8436:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783969326.258394:0:8436:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac783021000 00000020:00000080:0.0:1783969326.258396:0:8436:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783969326.258463:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7ae9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8436:1870627280554752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969326.258505:0:8436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969326.258531:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280554752 00000100:00100000:0.0:1783969326.258535:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280554752 00000100:00100000:0.0:1783969326.258567:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1783969326.258575:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:8436:x1870627280554752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969326.258697:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:8436:x1870627280554752:12345-0@lo:502:llog_process_th.0 Request processed in 122us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969326.258704:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1783969326.258738:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b5224000 going to sleep for 11 seconds 00000100:00100000:0.0:1783969326.258750:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7ae9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:8436:1870627280554752:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783969326.258767:0:8436:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969326.258776:0:8436:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969326.258778:0:8436:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783969326.258782:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783969326.258835:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1783969326.258848:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783969326.258984:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de7800/0xbacf56d076faadc6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faadcd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969326.258995:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac783de7800/0xbacf56d076faadc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faadcd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969326.630249:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969327.655912:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969327.681213:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969327.681253:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969327.681293:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969327.681314:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969327.681344:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272137344 00000100:00100000:2.0:1783969327.681353:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272137344 00000100:00100000:2.0:1783969327.681404:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272137216 00000100:00100000:2.0:1783969327.681413:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272137216 00000100:00100000:2.0:1783969327.681436:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 14 00000100:00100000:2.0:1783969327.681447:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+5:2350:x1870627272137344:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783969327.681521:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+5:2350:x1870627272137344:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 76us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969327.681529:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 14 00000100:00100000:2.0:1783969327.681546:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00100000:2.0:1783969327.681552:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+5:2350:x1870627272137216:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783969327.681579:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+5:2350:x1870627272137216:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 27us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969327.681585:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00080000:2.0:1783969327.681600:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783969327.681604:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783969327.682936:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272137088 00000100:00100000:2.0:1783969327.682948:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272137088 00000100:00100000:2.0:1783969327.683085:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 30 00000100:00100000:2.0:1783969327.683095:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+6:2350:x1870627272137088:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783969327.683155:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+6:2350:x1870627272137088:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 61us (1963us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969327.683163:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 30 00000100:00080000:0.0:1783969327.683168:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969327.685167:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272136960 00000100:00100000:3.0:1783969327.685178:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272136960 00000100:00100000:3.0:1783969327.686630:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 190 00000100:00100000:3.0:1783969327.686645:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:2350:x1870627272136960:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969327.686736:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:2350:x1870627272136960:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 95us (5441us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969327.686744:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 190 00010000:00010000:1.0:1783969328.680378:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969328.742030:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969328.742051:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280554880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969328.742117:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969328.742329:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280554880 00000100:00100000:2.0:1783969328.742338:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280554880 00000100:00080000:1.0:1783969328.742399:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969328.742411:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783969328.742422:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280554880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969328.742456:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783969328.742526:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280554880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969328.742541:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1783969328.742702:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac78872f800 x1870627280554880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969328.742721:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280554880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969329.253186:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280555008:0@lo:400:kworker.0 00000100:00100000:1.0:1783969329.253264:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969329.253378:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969329.253386:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280555136:0@lo:400:kworker.0 00000100:00100000:1.0:1783969329.253419:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969329.253460:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280555008 00000100:00100000:1.0:1783969329.253467:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280555008 00000100:00100000:1.0:1783969329.253516:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1783969329.253525:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3287:x1870627280555008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969329.253579:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3287:x1870627280555008:12345-0@lo:400:kworker.0 Request processed in 55us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969329.253587:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1783969329.253627:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280555136 00000100:00100000:1.0:1783969329.253632:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280555136 00000100:00100000:1.0:1783969329.253673:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783969329.253680:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280555136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969329.253712:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280555136:12345-0@lo:400:kworker.0 Request processed in 32us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969329.253719:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783969329.254110:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280555392:0@lo:400:kworker.0 00000100:00100000:0.0:1783969329.254326:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280555264:0@lo:400:kworker.0 00000100:00100000:0.0:1783969329.254361:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969329.254426:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969329.254494:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280555264 00000100:00100000:2.0:1783969329.254498:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280555264 00000100:00100000:2.0:1783969329.254533:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783969329.254540:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280555264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969329.254575:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7ae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280555264:12345-0@lo:400:kworker.0 Request processed in 36us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969329.254582:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783969329.254631:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280555392 00000100:00100000:0.0:1783969329.254635:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280555392 00000100:00100000:0.0:1783969329.254711:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783969329.254718:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280555392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969329.254753:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280555392:12345-0@lo:400:kworker.0 Request processed in 36us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969329.254760:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783969329.254831:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280555264:0@lo:400:kworker.0 00010000:00080000:0.0:1783969329.256834:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac681f4d880 x1870627280555392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969329.256854:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280555392:0@lo:400:kworker.0 00000100:00100000:1.0:1783969329.257050:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280555136:0@lo:400:kworker.0 00000100:00100000:1.0:1783969329.257078:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280555008:0@lo:400:kworker.0 00000100:00100000:1.0:1783969329.257114:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac682513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1870627280555520:0@lo:400:kworker.0 00000100:00100000:1.0:1783969329.257164:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969329.257191:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969329.257200:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac682511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280555648:0@lo:400:kworker.0 00000100:00100000:0.0:1783969329.257201:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280555520 00000100:00100000:0.0:1783969329.257213:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280555520 00000100:00100000:1.0:1783969329.257229:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969329.257265:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1783969329.257266:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969329.257275:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1870627280555520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969329.257332:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280555648 00000100:00100000:0.0:1783969329.257334:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1870627280555520:12345-0@lo:400:kworker.0 Request processed in 60us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969329.257337:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280555648 00000100:00100000:0.0:1783969329.257340:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783969329.257366:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783969329.257373:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280555648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969329.257408:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280555648:12345-0@lo:400:kworker.0 Request processed in 35us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969329.257414:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1783969329.258358:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783969329.258389:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac682511500 x1870627280555648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969329.258403:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac682511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280555648:0@lo:400:kworker.0 00000100:00100000:1.0:1783969329.258414:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac682513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1870627280555520:0@lo:400:kworker.0 00010000:00010000:0.0:1783969329.703303:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969329.765222:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783969329.765244:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac682510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280555776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783969329.765308:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969329.765491:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280555776 00000100:00100000:2.0:1783969329.765499:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280555776 00000100:00100000:2.0:1783969329.765548:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783969329.765557:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280555776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783969329.765590:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783969329.765639:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280555776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969329.765656:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1783969329.765694:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac682510e00 x1870627280555776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969329.765711:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac682510e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280555776:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1783969330.621118:0:8659:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1783969330.726044:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969331.752710:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969332.773022:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969332.792749:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969332.792791:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969332.792842:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969332.792908:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969332.792941:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272137728 00000100:00100000:2.0:1783969332.792950:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272137728 00000100:00100000:2.0:1783969332.793004:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272137856 00000100:00100000:2.0:1783969332.793007:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272137856 00000100:00100000:2.0:1783969332.793026:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:2.0:1783969332.793035:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+5:2351:x1870627272137728:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969332.793093:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272137600 00000100:00100000:3.0:1783969332.793100:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272137600 00000100:00100000:2.0:1783969332.793105:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+5:2351:x1870627272137728:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 69us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969332.793114:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:2.0:1783969332.793136:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:3.0:1783969332.793146:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 34 00000100:00100000:2.0:1783969332.793147:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682511c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+5:2351:x1870627272137856:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969332.793159:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+6:2351:x1870627272137600:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783969332.793177:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682511c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+5:2351:x1870627272137856:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 33us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969332.793185:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00080000:2.0:1783969332.793204:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783969332.793209:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783969332.793211:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969332.793214:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+6:2351:x1870627272137600:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 46us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969332.793223:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 34 00000100:00100000:1.0:1783969332.793615:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272137472 00000100:00100000:1.0:1783969332.793621:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272137472 00000100:00100000:1.0:1783969332.793704:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 192 00000100:00100000:1.0:1783969332.793712:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:2351:x1870627272137472:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969332.793754:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:2351:x1870627272137472:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 43us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969332.793761:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 192 00010000:00010000:2.0:1783969333.797492:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969333.866434:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969333.866455:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280555904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969333.866520:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969333.866582:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280555904 00000100:00100000:3.0:1783969333.866589:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280555904 00000100:00100000:3.0:1783969333.866649:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783969333.866659:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280555904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783969333.866691:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783969333.866733:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280555904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969333.866740:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1783969333.866759:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783969333.866787:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7c1531f80 x1870627280555904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969333.866804:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280555904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783969334.382284:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280556032:0@lo:400:kworker.0 00000100:00100000:2.0:1783969334.382348:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969334.382387:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1870627280556544:0@lo:400:kworker.0 00000100:00100000:2.0:1783969334.382408:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969334.382432:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783969334.382437:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280556160:0@lo:400:kworker.0 00000100:00100000:2.0:1783969334.382463:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969334.382478:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280556672:0@lo:400:kworker.0 00000100:00100000:2.0:1783969334.382495:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969334.382520:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280556032 00000100:00100000:2.0:1783969334.382525:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280556032 00000100:00100000:2.0:1783969334.382562:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1783969334.382569:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3287:x1870627280556032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969334.382608:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3287:x1870627280556032:12345-0@lo:400:kworker.0 Request processed in 39us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969334.382627:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1783969334.382655:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280556544 00000100:00100000:2.0:1783969334.382658:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280556544 00000100:00100000:2.0:1783969334.382684:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280556160 00000100:00100000:2.0:1783969334.382687:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280556160 00000100:00100000:2.0:1783969334.382701:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783969334.382706:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1870627280556544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969334.382731:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1870627280556544:12345-0@lo:400:kworker.0 Request processed in 25us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969334.382736:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783969334.382746:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783969334.382750:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280556160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969334.382769:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280556160:12345-0@lo:400:kworker.0 Request processed in 19us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969334.382775:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783969334.382795:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280556672 00000100:00100000:2.0:1783969334.382798:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280556672 00000100:00100000:2.0:1783969334.382832:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783969334.382843:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280556672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969334.382897:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280556672:12345-0@lo:400:kworker.0 Request processed in 54us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969334.382903:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783969334.382958:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280556160:0@lo:400:kworker.0 00010000:00080000:2.0:1783969334.382969:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7c1532300 x1870627280556672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969334.382979:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280556672:0@lo:400:kworker.0 00000100:00100000:2.0:1783969334.382985:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280556032:0@lo:400:kworker.0 00000100:00100000:2.0:1783969334.382992:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1870627280556544:0@lo:400:kworker.0 00000100:00100000:0.0:1783969334.383731:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280556288:0@lo:400:kworker.0 00000100:00100000:0.0:1783969334.383766:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969334.383787:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783969334.383794:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280556416:0@lo:400:kworker.0 00000100:00100000:0.0:1783969334.383823:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969334.383849:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280556416 00000100:00100000:0.0:1783969334.383853:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280556416 00000100:00100000:0.0:1783969334.383890:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783969334.383896:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7aeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280556416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969334.384051:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280556288 00000100:00100000:2.0:1783969334.384054:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280556288 00000100:00100000:2.0:1783969334.384077:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783969334.384082:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7ae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280556288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969334.384113:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7ae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280556288:12345-0@lo:400:kworker.0 Request processed in 31us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969334.384119:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783969334.384153:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280556288:0@lo:400:kworker.0 00000100:00100000:0.0:1783969334.384244:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7aeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280556416:12345-0@lo:400:kworker.0 Request processed in 347us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969334.384251:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1783969334.387223:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7c1532680 x1870627280556416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969334.387241:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280556416:0@lo:400:kworker.0 00000100:00080000:2.0:1783969334.389028:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783969334.389037:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783969334.827297:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969334.889929:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280556800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783969334.889999:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969334.890072:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280556800 00000100:00100000:3.0:1783969334.890079:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280556800 00000100:00100000:3.0:1783969334.890123:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783969334.890132:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280556800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783969334.890166:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783969334.890209:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280556800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969334.890216:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1783969334.892136:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7c1530700 x1870627280556800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969334.892170:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280556800:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783969335.850353:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783969335.858534:0:8903:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing yml_node 00010000:00010000:2.0:1783969336.873229:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969337.893093:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969337.918237:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969337.918291:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969337.918336:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272137984 00000100:00100000:1.0:1783969337.918348:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272137984 00000100:00100000:1.0:1783969337.918448:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 194 00000100:00100000:1.0:1783969337.918458:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:2349:x1870627272137984:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783969337.918497:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969337.918524:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272138240 00000100:00100000:2.0:1783969337.918529:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272138240 00000100:00100000:1.0:1783969337.918547:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:2349:x1870627272137984:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 89us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969337.918569:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 194 00000100:00100000:2.0:1783969337.918607:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:2.0:1783969337.918688:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+5:2347:x1870627272138240:12345-192.168.203.39@tcp:9:kworker.0 00000020:00000080:2.0:1783969337.918719:0:6593:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faad09 00000100:00080000:2.0:1783969337.918731:0:6593:0:(import.c:65:import_set_state_nolock()) ffff9ac6827e0000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1783969337.918738:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783969337.918757:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1783969337.918770:0:6593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1783969337.919247:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+2:2347:x1870627272138240:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 630us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969337.919255:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:3.0:1783969337.930914:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272138112 00000100:00100000:3.0:1783969337.930929:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272138112 00000100:00100000:3.0:1783969337.931014:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 38 00000100:00100000:3.0:1783969337.931026:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+6:2349:x1870627272138112:12345-192.168.203.39@tcp:400:kworker.0 00000100:00080000:1.0:1783969337.931147:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969337.931444:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+6:2349:x1870627272138112:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 420us (13156us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969337.931453:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 38 00000100:00100000:2.0:1783969337.931730:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969337.935007:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272138368 00000100:00100000:0.0:1783969337.935021:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272138368 00000100:00100000:0.0:1783969337.935109:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:0.0:1783969337.935121:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682513b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+5:2347:x1870627272138368:12345-192.168.203.39@tcp:9:kworker.0 00000020:00000080:0.0:1783969337.935161:0:6595:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faad10 00000100:00080000:0.0:1783969337.935171:0:6595:0:(import.c:65:import_set_state_nolock()) ffff9ac7ba65d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783969337.935220:0:6595:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1783969337.935487:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969337.935560:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682513b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+2:2347:x1870627272138368:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 441us (3829us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969337.935582:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00080000:1.0:1783969337.936686:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783969338.917745:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969338.985126:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783969338.985148:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280556928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783969338.985213:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969338.985624:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280556928 00000100:00100000:0.0:1783969338.985633:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280556928 00000100:00100000:0.0:1783969338.985701:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783969338.985711:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280556928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783969338.985748:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783969338.985796:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280556928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969338.985803:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1783969338.985844:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7a7aeaa00 x1870627280556928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969338.985894:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280556928:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783969338.986042:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969339.493690:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1870627280557440:0@lo:400:kworker.0 00000100:00100000:3.0:1783969339.493757:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969339.493813:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783969339.493820:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1870627280557312:0@lo:400:kworker.0 00000100:00100000:0.0:1783969339.493988:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280557056:0@lo:400:kworker.0 00000100:00100000:0.0:1783969339.494025:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969339.494050:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280557568:0@lo:400:kworker.0 00000100:00100000:0.0:1783969339.494073:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969339.494092:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783969339.494098:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280557184:0@lo:400:kworker.0 00000100:00100000:0.0:1783969339.494147:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280557056 00000100:00100000:0.0:1783969339.494154:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280557056 00000100:00100000:0.0:1783969339.494197:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1783969339.494204:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+19:3287:x1870627280557056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969339.494250:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+19:3287:x1870627280557056:12345-0@lo:400:kworker.0 Request processed in 46us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969339.494266:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1783969339.494297:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280557568 00000100:00100000:0.0:1783969339.494301:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280557568 00000100:00100000:0.0:1783969339.494345:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783969339.494351:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280557568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969339.494382:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280557568:12345-0@lo:400:kworker.0 Request processed in 31us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969339.494388:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1783969339.494409:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783969339.494963:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969339.495006:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280557440 00000100:00100000:3.0:1783969339.495010:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280557440 00000100:00100000:3.0:1783969339.495038:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280557312 00000100:00100000:3.0:1783969339.495041:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280557312 00000100:00100000:3.0:1783969339.495062:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783969339.495068:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1870627280557440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969339.495110:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1870627280557440:12345-0@lo:400:kworker.0 Request processed in 42us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969339.495187:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783969339.495203:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783969339.495208:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1870627280557312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969339.495237:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1870627280557312:12345-0@lo:400:kworker.0 Request processed in 29us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969339.495242:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783969339.495279:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1870627280557312:0@lo:400:kworker.0 00000100:00100000:3.0:1783969339.495290:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1870627280557440:0@lo:400:kworker.0 00000100:00100000:0.0:1783969339.496371:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969339.496777:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280557184 00000100:00100000:3.0:1783969339.496784:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280557184 00000100:00100000:3.0:1783969339.496830:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783969339.496838:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280557184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969339.497310:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7ae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280557184:12345-0@lo:400:kworker.0 Request processed in 471us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969339.497327:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1783969339.497362:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969339.498292:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280557056:0@lo:400:kworker.0 00010000:00080000:0.0:1783969339.498338:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7c1532300 x1870627280557568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969339.498361:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280557568:0@lo:400:kworker.0 00000100:00100000:0.0:1783969339.498390:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1531c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280557184:0@lo:400:kworker.0 00010000:00010000:1.0:1783969339.943292:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783969339.994232:0:9095:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.162 00000100:00100000:0.0:1783969340.005341:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280557696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969340.005802:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969340.006124:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280557696 00000100:00100000:3.0:1783969340.006132:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280557696 00000100:00100000:3.0:1783969340.006184:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783969340.006193:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280557696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783969340.006228:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783969340.006289:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280557696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969340.006296:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1783969340.006345:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7c1531f80 x1870627280557696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969340.006366:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280557696:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1783969340.609343:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 03985e57-ffb4-414b-b30c-e72697857d4f 00000020:00000080:0.0:1783969340.609353:0:6622:0:(genops.c:906:class_export_put()) final put ffff9ac6827e3000/03985e57-ffb4-414b-b30c-e72697857d4f 00000020:00000080:0.0:1783969340.609450:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac6827e3000/03985e57-ffb4-414b-b30c-e72697857d4f for lustre-OST0000 00000020:00000080:0.0:1783969340.609489:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ac6827e0000 for lustre-OST0000 00010000:00010000:3.0:1783969340.968051:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969341.991651:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783969342.689298:0:7494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 03985e57-ffb4-414b-b30c-e72697857d4f 00000020:00000080:3.0:1783969342.689308:0:7494:0:(genops.c:906:class_export_put()) final put ffff9ac7ba65a000/03985e57-ffb4-414b-b30c-e72697857d4f 00000020:00000080:3.0:1783969342.689332:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7ba65a000/03985e57-ffb4-414b-b30c-e72697857d4f for lustre-OST0001 00000020:00000080:3.0:1783969342.689368:0:483:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ac7ba65d800 for lustre-OST0001 00000001:02000400:1.0:1783969342.760719:0:9195:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.162 00010000:00010000:0.0:1783969343.013089:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969343.034321:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969343.034373:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969343.034401:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272138496 00000100:00100000:1.0:1783969343.034410:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272138496 00000100:00100000:1.0:1783969343.034454:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 196 00000100:00100000:1.0:1783969343.034464:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:2351:x1870627272138496:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969343.034530:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:2351:x1870627272138496:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 66us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969343.034538:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 196 00000100:00100000:3.0:1783969343.034984:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272138624 00000100:00100000:3.0:1783969343.034989:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272138624 00000100:00100000:3.0:1783969343.035036:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 42 00000100:00100000:3.0:1783969343.035043:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+6:2350:x1870627272138624:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969343.035086:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+6:2350:x1870627272138624:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 42us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969343.035092:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 42 00000100:00080000:1.0:1783969343.035153:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783969344.037077:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969344.101599:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783969344.101622:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7aea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280557824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783969344.101682:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969344.101988:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280557824 00000100:00100000:3.0:1783969344.101996:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280557824 00000100:00100000:3.0:1783969344.102068:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783969344.102078:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280557824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783969344.102114:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1783969344.102232:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969344.102316:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280557824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 239us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969344.102336:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1783969344.107965:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7a7aea300 x1870627280557824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969344.108410:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7aea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280557824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969344.616168:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280557952:0@lo:400:kworker.0 00000100:00100000:3.0:1783969344.616323:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969344.616386:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280558464:0@lo:400:kworker.0 00000100:00100000:3.0:1783969344.616421:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969344.616456:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783969344.616885:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1870627280558336:0@lo:400:kworker.0 00000100:00100000:3.0:1783969344.616925:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969344.616975:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280558080:0@lo:400:kworker.0 00000100:00100000:3.0:1783969344.617012:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969344.617140:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280558336 00000100:00100000:1.0:1783969344.617148:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280558336 00000100:00100000:1.0:1783969344.617208:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280558080 00000100:00100000:1.0:1783969344.617212:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280558080 00000100:00100000:1.0:1783969344.617538:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783969344.617563:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1870627280558336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969344.617688:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969344.617699:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280558208:0@lo:400:kworker.0 00000100:00100000:3.0:1783969344.617736:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969344.617780:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280557952 00000100:00100000:3.0:1783969344.617784:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280557952 00000100:00100000:3.0:1783969344.617826:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1783969344.617836:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:3286:x1870627280557952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969344.617909:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:3286:x1870627280557952:12345-0@lo:400:kworker.0 Request processed in 74us (1663us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969344.617918:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1783969344.617962:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280558464 00000100:00100000:3.0:1783969344.617966:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280558464 00000100:00100000:3.0:1783969344.618009:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783969344.618018:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280558464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969344.618154:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1870627280558336:12345-0@lo:400:kworker.0 Request processed in 604us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969344.618163:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783969344.618183:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280558208 00000100:00100000:1.0:1783969344.618187:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280558208 00000100:00100000:1.0:1783969344.618214:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783969344.618222:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280558080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969344.618562:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280558080:12345-0@lo:400:kworker.0 Request processed in 329us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969344.618569:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783969344.618583:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783969344.618589:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280558208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969344.618683:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280558208:12345-0@lo:400:kworker.0 Request processed in 93us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969344.618689:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1783969344.618710:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783969344.618715:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969344.618755:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280558208:0@lo:400:kworker.0 00000100:00100000:1.0:1783969344.618766:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280558080:0@lo:400:kworker.0 00000100:00100000:3.0:1783969344.618841:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1531f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280558464:12345-0@lo:400:kworker.0 Request processed in 825us (2421us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969344.618882:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783969344.618922:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1870627280558336:0@lo:400:kworker.0 00000100:00100000:3.0:1783969344.618931:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280557952:0@lo:400:kworker.0 00010000:00080000:3.0:1783969344.618943:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7c1533b80 x1870627280558464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969344.618953:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280558464:0@lo:400:kworker.0 00010000:00010000:0.0:1783969345.062082:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969345.125709:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783969345.125730:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac682510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280558592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783969345.125796:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969345.126026:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280558592 00000100:00100000:0.0:1783969345.126034:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280558592 00000100:00100000:0.0:1783969345.126094:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783969345.126103:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682512d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280558592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783969345.126137:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783969345.126283:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682512d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280558592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 180us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969345.126290:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1783969345.130886:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac682510000 x1870627280558592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969345.130911:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac682510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280558592:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1783969345.173455:0:9292:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.162 00010000:00010000:1.0:1783969346.085316:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783969346.597552:0:9341:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Jul 13 15:02:25 EDT 2026 00010000:00010000:3.0:1783969347.109055:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969348.140082:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969348.151781:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969348.151845:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969348.151909:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272138752 00000100:00100000:1.0:1783969348.151918:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272138752 00000100:00100000:1.0:1783969348.151966:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 198 00000100:00100000:1.0:1783969348.151977:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:2348:x1870627272138752:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969348.152045:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:2348:x1870627272138752:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 69us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969348.152052:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 198 00000100:00100000:3.0:1783969348.152214:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272138880 00000100:00100000:3.0:1783969348.152219:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272138880 00000100:00100000:3.0:1783969348.152268:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 46 00000100:00100000:3.0:1783969348.152276:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+6:2348:x1870627272138880:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969348.152317:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+6:2348:x1870627272138880:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 42us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969348.152324:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 46 00000100:00080000:1.0:1783969348.152978:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783969349.158598:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969349.222018:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280558720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969349.222085:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969349.222189:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280558720 00000100:00100000:2.0:1783969349.222197:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280558720 00000100:00100000:2.0:1783969349.222269:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783969349.222278:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280558720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969349.222313:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1783969349.222368:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969349.222594:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280558720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 317us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969349.222602:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1783969349.222687:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7a7aeb480 x1870627280558720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969349.222705:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280558720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969349.733171:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1870627280559232:0@lo:400:kworker.0 00000100:00100000:1.0:1783969349.733242:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969349.733308:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783969349.733315:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1870627280559104:0@lo:400:kworker.0 00000100:00100000:1.0:1783969349.733339:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969349.733373:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280559232 00000100:00100000:1.0:1783969349.733380:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280559232 00000100:00100000:1.0:1783969349.733425:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280559104 00000100:00100000:1.0:1783969349.733429:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280559104 00000100:00100000:1.0:1783969349.733451:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783969349.733459:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870627280559232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969349.733508:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870627280559232:12345-0@lo:400:kworker.0 Request processed in 49us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969349.733538:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783969349.733554:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783969349.733560:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870627280559104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969349.733590:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870627280559104:12345-0@lo:400:kworker.0 Request processed in 30us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969349.733612:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783969349.733647:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba610e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1870627280559104:0@lo:400:kworker.0 00000100:00100000:1.0:1783969349.733656:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1870627280559232:0@lo:400:kworker.0 00000100:00100000:0.0:1783969349.733757:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1870627280558976:0@lo:400:kworker.0 00000100:00100000:0.0:1783969349.733784:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969349.733807:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783969349.733812:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280558848:0@lo:400:kworker.0 00000100:00100000:0.0:1783969349.733835:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969349.733856:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280559360:0@lo:400:kworker.0 00000100:00100000:0.0:1783969349.733900:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969349.733922:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280558848 00000100:00100000:0.0:1783969349.733925:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280558848 00000100:00100000:0.0:1783969349.733949:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1783969349.733954:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3286:x1870627280558848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969349.733982:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3286:x1870627280558848:12345-0@lo:400:kworker.0 Request processed in 28us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969349.733987:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1783969349.734010:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280559360 00000100:00100000:0.0:1783969349.734013:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280559360 00000100:00100000:0.0:1783969349.734033:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783969349.734038:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280559360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969349.734064:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7ae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280559360:12345-0@lo:400:kworker.0 Request processed in 25us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969349.734079:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783969349.734103:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280558848:0@lo:400:kworker.0 00010000:00080000:0.0:1783969349.734115:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7ba612300 x1870627280559360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969349.734124:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280559360:0@lo:400:kworker.0 00000100:00100000:3.0:1783969349.734209:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280558976 00000100:00100000:3.0:1783969349.734213:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280558976 00000100:00100000:3.0:1783969349.734248:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783969349.734255:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1870627280558976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969349.734333:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7aeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1870627280558976:12345-0@lo:400:kworker.0 Request processed in 78us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969349.734339:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1783969349.734354:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783969349.734364:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969349.734386:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1870627280558976:0@lo:400:kworker.0 00010000:00010000:3.0:1783969350.181085:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969350.247093:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969350.247116:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac682511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280559488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969350.247200:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969350.247387:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280559488 00000100:00100000:2.0:1783969350.247395:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280559488 00000100:00100000:2.0:1783969350.247443:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783969350.247453:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280559488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783969350.247489:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783969350.247553:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280559488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969350.247560:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1783969350.247706:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac682511180 x1870627280559488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969350.247725:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac682511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280559488:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783969351.206220:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969352.229061:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969353.256370:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969353.280397:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969353.280440:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969353.280473:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272139136 00000100:00100000:1.0:1783969353.280482:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272139136 00000100:00100000:1.0:1783969353.280557:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 50 00000100:00100000:1.0:1783969353.280569:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+6:2350:x1870627272139136:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969353.280644:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+6:2350:x1870627272139136:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 77us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969353.280651:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 50 00000100:00100000:1.0:1783969353.280685:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272139008 00000100:00100000:1.0:1783969353.280689:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272139008 00000100:00100000:1.0:1783969353.280726:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 200 00000100:00100000:1.0:1783969353.280734:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:2350:x1870627272139008:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969353.280911:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:2350:x1870627272139008:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 178us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969353.280919:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 200 00000100:00080000:1.0:1783969353.280943:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783969354.279566:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969354.341015:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280559616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783969354.341080:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969354.341145:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280559616 00000100:00100000:0.0:1783969354.341153:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280559616 00000100:00100000:0.0:1783969354.341202:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1783969354.341203:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783969354.341212:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7aea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280559616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783969354.341244:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783969354.341287:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7aea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280559616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969354.341293:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1783969354.341520:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7a7aeb480 x1870627280559616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969354.341539:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280559616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969354.859235:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1870627280560128:0@lo:400:kworker.0 00000100:00100000:1.0:1783969354.859303:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969354.859356:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783969354.859362:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280559744:0@lo:400:kworker.0 00000100:00100000:1.0:1783969354.859390:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969354.859411:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280560256:0@lo:400:kworker.0 00000100:00100000:1.0:1783969354.859434:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969354.859459:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1870627280559872:0@lo:400:kworker.0 00000100:00100000:1.0:1783969354.859495:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969354.859516:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969354.859523:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280560000:0@lo:400:kworker.0 00000100:00100000:1.0:1783969354.859546:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969354.859575:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280560128 00000100:00100000:1.0:1783969354.859582:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280560128 00000100:00100000:1.0:1783969354.859624:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280559872 00000100:00100000:1.0:1783969354.859628:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280559872 00000100:00100000:1.0:1783969354.859641:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280560000 00000100:00100000:1.0:1783969354.859643:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280560000 00000100:00100000:1.0:1783969354.859671:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783969354.859679:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1870627280560128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969354.859730:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798164380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1870627280560128:12345-0@lo:400:kworker.0 Request processed in 52us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969354.859738:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783969354.859754:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783969354.859761:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1870627280559872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969354.859793:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1870627280559872:12345-0@lo:400:kworker.0 Request processed in 33us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969354.859799:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783969354.859810:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783969354.859817:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280560000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969354.859847:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280560000:12345-0@lo:400:kworker.0 Request processed in 30us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969354.859853:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783969354.859893:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280559744 00000100:00100000:1.0:1783969354.859897:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280559744 00000100:00100000:1.0:1783969354.859919:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1783969354.859926:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+19:3287:x1870627280559744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969354.859957:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+19:3287:x1870627280559744:12345-0@lo:400:kworker.0 Request processed in 31us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969354.859964:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1783969354.860138:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280560256 00000100:00100000:1.0:1783969354.860142:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280560256 00000100:00100000:1.0:1783969354.860209:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783969354.860217:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280560256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969354.860256:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280560256:12345-0@lo:400:kworker.0 Request processed in 40us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969354.860263:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1783969354.860989:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783969354.860995:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969354.863020:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba610700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280559744:0@lo:400:kworker.0 00010000:00080000:0.0:1783969354.863043:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7ba611500 x1870627280560256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969354.863054:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba611500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280560256:0@lo:400:kworker.0 00000100:00100000:0.0:1783969354.863086:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba612300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1870627280560128:0@lo:400:kworker.0 00000100:00100000:3.0:1783969354.865035:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba611180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280560000:0@lo:400:kworker.0 00000100:00100000:3.0:1783969354.865053:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1870627280559872:0@lo:400:kworker.0 00010000:00010000:1.0:1783969355.301073:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969355.365818:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783969355.365839:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280560384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969355.365949:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969355.365997:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280560384 00000100:00100000:3.0:1783969355.366006:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280560384 00000100:00100000:3.0:1783969355.366069:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783969355.366080:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280560384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783969355.366114:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783969355.366167:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280560384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969355.366174:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1783969355.366260:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac785316680 x1870627280560384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969355.366277:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280560384:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783969356.328369:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969357.349806:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969358.373107:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969358.390297:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969358.390343:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969358.390417:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272139264 00000100:00100000:1.0:1783969358.390430:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272139264 00000100:00100000:1.0:1783969358.390500:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 202 00000100:00100000:1.0:1783969358.390509:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:2351:x1870627272139264:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969358.390581:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:2351:x1870627272139264:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 72us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969358.390588:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 202 00000100:00100000:3.0:1783969358.391165:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272139392 00000100:00100000:3.0:1783969358.391172:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272139392 00000100:00100000:3.0:1783969358.391238:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 54 00000100:00100000:3.0:1783969358.391253:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+6:2351:x1870627272139392:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969358.391301:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7aeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+6:2351:x1870627272139392:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 56us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969358.391308:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 54 00000100:00080000:1.0:1783969358.391515:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783969359.397108:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969359.461267:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7ba612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280560512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969359.461334:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969359.462005:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280560512 00000100:00100000:3.0:1783969359.462027:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280560512 00000100:00100000:3.0:1783969359.462102:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783969359.462112:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280560512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783969359.462145:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1783969359.462221:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969359.470439:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf636d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280560512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8319us (9095us total) trans 0 rc 0/0 00010000:00080000:1.0:1783969359.470441:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7ba612a00 x1870627280560512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969359.470466:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783969359.470494:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7ba612a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280560512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783969359.973161:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac682513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280561024:0@lo:400:kworker.0 00000100:00100000:2.0:1783969359.973231:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969359.973296:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783969359.973302:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac682510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1870627280560896:0@lo:400:kworker.0 00000100:00100000:2.0:1783969359.973329:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969359.973357:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280561024 00000100:00100000:2.0:1783969359.973363:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280561024 00000100:00100000:2.0:1783969359.973407:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783969359.973416:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280561024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969359.973585:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac682510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280560640:0@lo:400:kworker.0 00000100:00100000:0.0:1783969359.973619:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969359.973641:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac682511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1870627280561152:0@lo:400:kworker.0 00000100:00100000:0.0:1783969359.973662:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969359.973679:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783969359.973684:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac682511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280560768:0@lo:400:kworker.0 00000100:00100000:0.0:1783969359.973703:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969359.973719:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a787d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280561280:0@lo:400:kworker.0 00000100:00100000:0.0:1783969359.973739:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969359.973761:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280560896 00000100:00100000:0.0:1783969359.973765:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280560896 00000100:00100000:0.0:1783969359.973798:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280561152 00000100:00100000:0.0:1783969359.973800:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280561152 00000100:00100000:0.0:1783969359.973815:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280560768 00000100:00100000:0.0:1783969359.973818:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280560768 00000100:00100000:0.0:1783969359.973831:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783969359.973837:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1870627280560896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969359.973892:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1870627280560896:12345-0@lo:400:kworker.0 Request processed in 54us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969359.973900:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783969359.973928:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783969359.973943:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1870627280561152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969359.973977:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1870627280561152:12345-0@lo:400:kworker.0 Request processed in 35us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969359.973983:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783969359.973996:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783969359.974002:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280560768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969359.974028:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280560768:12345-0@lo:400:kworker.0 Request processed in 27us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969359.974033:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1783969359.974055:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969359.974082:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac682511180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280560768:0@lo:400:kworker.0 00000100:00100000:0.0:1783969359.974092:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac682511500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1870627280561152:0@lo:400:kworker.0 00000100:00100000:0.0:1783969359.974128:0:6594:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1783969359.974136:0:6594:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1783969359.974163:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac682510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1870627280560896:0@lo:400:kworker.0 00010000:00080000:0.0:1783969359.974174:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac682513800 x1870627280561024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969359.974183:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac682513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280561024:0@lo:400:kworker.0 00000100:00100000:2.0:1783969359.974249:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280561024:12345-0@lo:400:kworker.0 Request processed in 833us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969359.974256:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783969359.974268:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280561280 00000100:00100000:2.0:1783969359.974273:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280561280 00000100:00100000:2.0:1783969359.974303:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783969359.974309:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280561280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969359.974344:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280561280:12345-0@lo:400:kworker.0 Request processed in 36us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969359.974350:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1783969359.974372:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7a787d500 x1870627280561280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969359.974382:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a787d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280561280:0@lo:400:kworker.0 00000100:00100000:1.0:1783969359.974668:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280560640 00000100:00100000:1.0:1783969359.974680:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280560640 00000100:00100000:1.0:1783969359.974717:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1783969359.974724:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:3287:x1870627280560640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969359.974766:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:3287:x1870627280560640:12345-0@lo:400:kworker.0 Request processed in 42us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969359.974772:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1783969359.974810:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac682510a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280560640:0@lo:400:kworker.0 00000100:00080000:0.0:1783969359.975090:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783969360.421255:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969360.485290:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783969360.485315:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280561408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969360.485380:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969360.485510:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280561408 00000100:00100000:1.0:1783969360.485518:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280561408 00000100:00100000:1.0:1783969360.485564:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783969360.485573:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba610700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280561408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783969360.485605:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783969360.485665:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba610700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280561408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969360.485672:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1783969360.485914:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7bf635180 x1870627280561408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969360.485934:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf635180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280561408:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1783969361.001730:0:9972:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 15:02:39 (1783969359) === 00000100:00100000:0.0:1783969361.372601:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969361.372691:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272139520 00000100:00100000:1.0:1783969361.372700:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272139520 00000100:00100000:1.0:1783969361.372764:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 204 00000100:00100000:1.0:1783969361.372775:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:8110:x1870627272139520:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783969361.372790:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969361.372816:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac781497400/0xbacf56d076faadd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6304d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969361.372844:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac781497400/0xbacf56d076faadd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6304d expref: 11 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969361.372856:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac781497400/0xbacf56d076faadd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6304d expref: 11 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969361.372910:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac781497400, rc 0) 00000100:00100000:1.0:1783969361.372967:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+11:8110:x1870627272139520:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 194us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969361.372975:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 204 00000100:00100000:3.0:1783969361.374511:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969361.374593:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272139648 00000100:00100000:1.0:1783969361.374600:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272139648 00000100:00100000:1.0:1783969361.375274:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 205 00000100:00100000:1.0:1783969361.375285:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+11:8110:x1870627272139648:12345-192.168.203.39@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783969361.375568:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+11:8110:x1870627272139648:12345-192.168.203.39@tcp:501:mount.lustre.0 Request processed in 284us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969361.375576:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 205 00000100:00100000:3.0:1783969361.377395:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969361.386397:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272139776 00000100:00100000:2.0:1783969361.386411:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272139776 00000100:00100000:2.0:1783969361.386483:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 206 00000100:00100000:2.0:1783969361.386492:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+11:8110:x1870627272139776:12345-192.168.203.39@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783969361.386912:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+11:8110:x1870627272139776:12345-192.168.203.39@tcp:503:mount.lustre.0 Request processed in 419us (9521us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969361.386928:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 206 00000100:00100000:3.0:1783969361.402304:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969361.402570:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272139904 00000100:00100000:2.0:1783969361.402581:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272139904 00000100:00100000:2.0:1783969361.402641:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 207 00000100:00100000:2.0:1783969361.402652:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+11:8114:x1870627272139904:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783969361.402970:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+11:8114:x1870627272139904:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 319us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969361.402979:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 207 00000100:00100000:3.0:1783969361.431194:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969361.431338:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272140032 00000100:00100000:0.0:1783969361.431348:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272140032 00000100:00100000:0.0:1783969361.431400:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 208 00000100:00100000:0.0:1783969361.431409:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+11:8114:x1870627272140032:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783969361.431676:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+11:8114:x1870627272140032:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 268us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969361.431685:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 208 00000100:00100000:3.0:1783969361.434351:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969361.434546:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272140160 00000100:00100000:1.0:1783969361.434554:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272140160 00000100:00100000:1.0:1783969361.434604:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 209 00000100:00100000:1.0:1783969361.434612:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+11:8110:x1870627272140160:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783969361.434626:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969361.434644:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac781497200/0xbacf56d076faaddb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63077 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969361.434669:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac781497200/0xbacf56d076faaddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63077 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969361.434681:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac781497200/0xbacf56d076faaddb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63077 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969361.434690:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac781497200, rc 0) 00000100:00100000:1.0:1783969361.434767:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+12:8110:x1870627272140160:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 155us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969361.434774:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 209 00000100:00100000:3.0:1783969361.443775:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969361.443982:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272140288 00000100:00100000:2.0:1783969361.443992:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272140288 00000100:00100000:2.0:1783969361.444046:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 210 00000100:00100000:2.0:1783969361.444056:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+12:8110:x1870627272140288:12345-192.168.203.39@tcp:256:mount.lustre.0 20000000:01000000:2.0:1783969361.444079:0:5786:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1783969361.444105:0:5786:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783969361.444109:0:5786:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783969361.444111:0:5786:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783969361.444114:0:5786:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00010000:00010000:1.0:1783969361.444989:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969361.446341:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+12:8110:x1870627272140288:12345-192.168.203.39@tcp:256:mount.lustre.0 Request processed in 2277us (2566us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969361.446353:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 210 00000100:00100000:3.0:1783969361.449646:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969361.449755:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272140416 00000100:00100000:0.0:1783969361.449764:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272140416 00000100:00100000:0.0:1783969361.449820:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 211 00000100:00100000:0.0:1783969361.449831:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+12:8110:x1870627272140416:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783969361.449847:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969361.449897:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7bfb93600/0xbacf56d076faade2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6307e expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969361.449925:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7bfb93600/0xbacf56d076faade2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6307e expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969361.449937:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7bfb93600/0xbacf56d076faade2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6307e expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969361.449945:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93600, rc 0) 00000100:00100000:0.0:1783969361.450003:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:8110:x1870627272140416:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 173us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969361.450009:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 211 00000100:00100000:3.0:1783969361.452103:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969361.452187:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272140544 00000100:00100000:2.0:1783969361.452195:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272140544 00000100:00100000:2.0:1783969361.452249:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 212 00000100:00100000:2.0:1783969361.452259:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:8110:x1870627272140544:12345-192.168.203.39@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783969361.452518:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:8110:x1870627272140544:12345-192.168.203.39@tcp:501:mount.lustre.0 Request processed in 259us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969361.452533:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 212 00000100:00100000:3.0:1783969361.454333:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969361.454416:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272140672 00000100:00100000:1.0:1783969361.454424:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272140672 00000100:00100000:1.0:1783969361.454480:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 213 00000100:00100000:1.0:1783969361.454490:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:8110:x1870627272140672:12345-192.168.203.39@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783969361.454687:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:8110:x1870627272140672:12345-192.168.203.39@tcp:503:mount.lustre.0 Request processed in 198us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969361.454694:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 213 00000100:00100000:3.0:1783969361.457337:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969361.457571:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272140800 00000100:00100000:0.0:1783969361.457580:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272140800 00000100:00100000:0.0:1783969361.457631:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 214 00000100:00100000:0.0:1783969361.457640:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:8118:x1870627272140800:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783969361.457941:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:8118:x1870627272140800:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 300us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969361.457949:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 214 00000100:00100000:3.0:1783969361.460668:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969361.460772:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272140928 00000100:00100000:2.0:1783969361.460781:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272140928 00000100:00100000:2.0:1783969361.460834:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 215 00000100:00100000:2.0:1783969361.460844:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:8118:x1870627272140928:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783969361.461106:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:8118:x1870627272140928:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 262us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969361.461114:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 215 00000100:00100000:3.0:1783969361.470077:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969361.470342:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272141056 00000100:00100000:0.0:1783969361.470351:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272141056 00000100:00100000:0.0:1783969361.470393:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:0.0:1783969361.470401:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2347:x1870627272141056:12345-192.168.203.39@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783969361.470429:0:5793:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 4af233ee-6a25-4eaf-90cc-2e5dc362fbb6@192.168.203.39@tcp t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:0.0:1783969361.470520:0:5793:0:(genops.c:1406:class_connect()) connect: client 4af233ee-6a25-4eaf-90cc-2e5dc362fbb6, cookie 0xbacf56d076faade9 00000004:00100000:0.0:1783969361.470549:0:5793:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:0.0:1783969361.470803:0:5793:0:(import.c:65:import_set_state_nolock()) ffff9ac7c18d5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783969361.471105:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+6:2347:x1870627272141056:12345-192.168.203.39@tcp:38:mount.lustre.0 Request processed in 701us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969361.471113:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:3.0:1783969361.475051:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969361.475141:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272141440 00000100:00100000:0.0:1783969361.475149:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272141440 00000100:00100000:0.0:1783969361.475221:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 58 00000100:00100000:0.0:1783969361.475241:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+6:2349:x1870627272141440:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969361.475328:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+6:2349:x1870627272141440:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 98us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969361.475336:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 58 00000100:00080000:2.0:1783969361.476487:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969361.484932:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969361.484973:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969361.485048:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272141184 00000100:00100000:3.0:1783969361.485057:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272141184 00000100:00100000:3.0:1783969361.485124:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272141312 00000100:00100000:3.0:1783969361.485127:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272141312 00000100:00100000:3.0:1783969361.485150:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:3.0:1783969361.485159:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+7:0:x1870627272141184:12345-192.168.203.39@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783969361.485198:0:5794:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1783969361.485294:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf634a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+7:0:x1870627272141184:12345-192.168.203.39@tcp:41:mount.lustre.0 Request processed in 136us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969361.485302:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:3.0:1783969361.485318:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00100000:3.0:1783969361.485325:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+6:8110:x1870627272141312:12345-192.168.203.39@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783969361.485336:0:5794:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1783969361.485355:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+6:8110:x1870627272141312:12345-192.168.203.39@tcp:41:mount.lustre.0 Request processed in 31us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969361.485362:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00080000:2.0:1783969361.486025:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969361.487665:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969361.487755:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272141568 00000100:00100000:3.0:1783969361.487763:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272141568 00000100:00100000:3.0:1783969361.487815:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:3.0:1783969361.487825:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+6:8110:x1870627272141568:12345-192.168.203.39@tcp:40:mount.lustre.0 00000100:00100000:3.0:1783969361.487918:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf635500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+6:8110:x1870627272141568:12345-192.168.203.39@tcp:40:mount.lustre.0 Request processed in 94us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969361.487925:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:3.0:1783969361.490224:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969361.490267:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969361.490311:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969361.490390:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272141696 00000100:00100000:2.0:1783969361.490400:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272141696 00000100:00100000:2.0:1783969361.490449:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272141824 00000100:00100000:2.0:1783969361.490451:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272141824 00000100:00100000:2.0:1783969361.490470:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00100000:2.0:1783969361.490478:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1870627272141696:12345-192.168.203.39@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783969361.490508:0:6595:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 4af233ee-6a25-4eaf-90cc-2e5dc362fbb6@192.168.203.39@tcp t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:2.0:1783969361.490535:0:6595:0:(genops.c:1406:class_connect()) connect: client 4af233ee-6a25-4eaf-90cc-2e5dc362fbb6, cookie 0xbacf56d076faadf0 00002000:00100000:2.0:1783969361.490547:0:6595:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4af233ee-6a25-4eaf-90cc-2e5dc362fbb6/ffff9ac7861de800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783969361.490569:0:6595:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:2.0:1783969361.490788:0:6595:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783969361.490815:0:6595:0:(import.c:65:import_set_state_nolock()) ffff9ac7861de000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783969361.490897:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+6:2347:x1870627272141696:12345-192.168.203.39@tcp:8:mount.lustre.0 Request processed in 418us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969361.490905:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00100000:2.0:1783969361.490932:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:2.0:1783969361.490936:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1870627272141824:12345-192.168.203.39@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783969361.490950:0:6595:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 4af233ee-6a25-4eaf-90cc-2e5dc362fbb6@192.168.203.39@tcp t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:2.0:1783969361.490964:0:6595:0:(genops.c:1406:class_connect()) connect: client 4af233ee-6a25-4eaf-90cc-2e5dc362fbb6, cookie 0xbacf56d076faadf7 00002000:00100000:2.0:1783969361.490969:0:6595:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4af233ee-6a25-4eaf-90cc-2e5dc362fbb6/ffff9ac7861d8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783969361.490975:0:6595:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:2.0:1783969361.491095:0:6595:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783969361.491108:0:6595:0:(import.c:65:import_set_state_nolock()) ffff9ac7861dd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783969361.491130:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+6:2347:x1870627272141824:12345-192.168.203.39@tcp:8:mount.lustre.0 Request processed in 192us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969361.491136:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:0.0:1783969361.491598:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272141952 00000100:00100000:0.0:1783969361.491604:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272141952 00000100:00100000:0.0:1783969361.491643:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1 00000100:00100000:0.0:1783969361.491651:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+6:8110:x1870627272141952:12345-192.168.203.39@tcp:33:mount.lustre.0 00000004:00200000:0.0:1783969361.492198:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1783969361.492337:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+6:8110:x1870627272141952:12345-192.168.203.39@tcp:33:mount.lustre.0 Request processed in 685us (2118us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969361.492345:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1 00010000:00010000:0.0:1783969362.469223:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783969363.104073:0:7494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4af233ee-6a25-4eaf-90cc-2e5dc362fbb6 00000001:00100000:2.0:1783969363.106383:0:5816:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4af233ee-6a25-4eaf-90cc-2e5dc362fbb6 00010000:00010000:3.0:1783969363.495154:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969364.520105:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969364.583768:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280561536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969364.583852:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969364.584029:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280561536 00000100:00100000:2.0:1783969364.584037:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280561536 00000100:00100000:2.0:1783969364.584090:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783969364.584100:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280561536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969364.584140:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1783969364.596289:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969364.596668:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280561536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 12565us (12811us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969364.596681:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1783969364.601164:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7bf635f80 x1870627280561536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969364.601214:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280561536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969365.094134:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a787d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280561664:0@lo:400:kworker.0 00000100:00100000:3.0:1783969365.094260:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a787d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870627280561792:0@lo:400:kworker.0 00000100:00100000:0.0:1783969365.094376:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a787dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280561920:0@lo:400:kworker.0 00000100:00100000:3.0:1783969365.094493:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969365.094550:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a787e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280562304:0@lo:400:kworker.0 00000100:00100000:3.0:1783969365.094572:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969365.094608:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a787e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280562048:0@lo:400:kworker.0 00000100:00100000:3.0:1783969365.094628:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969365.095456:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280561792 00000100:00100000:2.0:1783969365.095466:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280561792 00000100:00100000:2.0:1783969365.095522:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783969365.095531:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870627280561792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969365.095597:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870627280561792:12345-0@lo:400:kworker.0 Request processed in 67us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969365.095616:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783969365.095640:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280562304 00000100:00100000:2.0:1783969365.095654:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280562304 00000100:00100000:1.0:1783969365.095672:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969365.095685:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280562048 00000100:00100000:2.0:1783969365.095688:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280562048 00000100:00100000:2.0:1783969365.095703:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783969365.095703:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a787c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1870627280562176:0@lo:400:kworker.0 00000100:00100000:2.0:1783969365.095708:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280562304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969365.095731:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969365.095735:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280562304:12345-0@lo:400:kworker.0 Request processed in 27us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969365.095741:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783969365.095752:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783969365.095758:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280562048:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783969365.095758:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969365.095769:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280561664 00000100:00100000:1.0:1783969365.095772:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280561664 00000100:00100000:2.0:1783969365.095783:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280562048:12345-0@lo:400:kworker.0 Request processed in 26us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969365.095789:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783969365.095794:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1783969365.095800:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3287:x1870627280561664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969365.095843:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3287:x1870627280561664:12345-0@lo:400:kworker.0 Request processed in 43us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969365.095874:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1783969365.095905:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280562176 00000100:00100000:1.0:1783969365.095909:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280562176 00000100:00100000:1.0:1783969365.095937:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783969365.095943:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1870627280562176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969365.095975:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf634e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1870627280562176:12345-0@lo:400:kworker.0 Request processed in 31us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969365.095980:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1783969365.095996:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969365.096013:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a787d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280561664:0@lo:400:kworker.0 00000100:00100000:2.0:1783969365.096383:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a787d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870627280561792:0@lo:400:kworker.0 00010000:00080000:2.0:1783969365.096401:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7a787e300 x1870627280562304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969365.096411:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a787e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280562304:0@lo:400:kworker.0 00000100:00100000:1.0:1783969365.096590:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a787c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1870627280562176:0@lo:400:kworker.0 00000100:00100000:0.0:1783969365.097396:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783969365.097449:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7a787e680 x1870627280562048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969365.097461:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a787e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280562048:0@lo:400:kworker.0 00000100:00100000:1.0:1783969365.097509:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280561920 00000100:00100000:1.0:1783969365.097514:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280561920 00000100:00100000:1.0:1783969365.097566:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783969365.097574:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280561920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969365.097662:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280561920:12345-0@lo:400:kworker.0 Request processed in 88us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969365.097669:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1783969365.097703:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969365.097717:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a787dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280561920:0@lo:400:kworker.0 00010000:00010000:0.0:1783969365.544274:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969365.607408:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280562432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969365.607491:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969365.607699:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280562432 00000100:00100000:1.0:1783969365.607707:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280562432 00000100:00100000:1.0:1783969365.607770:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783969365.607779:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280562432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783969365.607814:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783969365.607886:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682510a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280562432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969365.607909:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1783969365.608071:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7bf635880 x1870627280562432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969365.608088:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280562432:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1783969366.221013:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4af233ee-6a25-4eaf-90cc-2e5dc362fbb6 00010000:00010000:3.0:1783969366.568236:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969366.587155:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969366.587321:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272142080 00000100:00100000:0.0:1783969366.587331:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272142080 00000100:00100000:0.0:1783969366.587384:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 217 00000100:00100000:0.0:1783969366.587393:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2350:x1870627272142080:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969366.587479:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2350:x1870627272142080:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 87us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969366.587497:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 217 00000100:00100000:0.0:1783969366.595291:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969366.595365:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969366.595386:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969366.600460:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969366.601618:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272142336 00000100:00100000:2.0:1783969366.601638:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272142336 00000100:00100000:2.0:1783969366.601693:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272142208 00000100:00100000:2.0:1783969366.601698:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272142208 00000100:00100000:2.0:1783969366.601726:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 62 00000100:00100000:2.0:1783969366.601735:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2350:x1870627272142336:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783969366.601813:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2350:x1870627272142336:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 78us (6529us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969366.601820:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 62 00000100:00100000:2.0:1783969366.601836:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 63 00000100:00100000:2.0:1783969366.601841:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+6:2350:x1870627272142208:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783969366.601948:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+6:2350:x1870627272142208:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 105us (6560us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969366.601955:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 63 00000100:00100000:2.0:1783969366.601976:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272142592 00000100:00100000:2.0:1783969366.601980:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272142592 00000100:00100000:2.0:1783969366.602003:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272142464 00000100:00100000:2.0:1783969366.602006:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272142464 00000100:00100000:2.0:1783969366.602022:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 30 00000100:00100000:2.0:1783969366.602028:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2350:x1870627272142592:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783969366.602052:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682510000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2350:x1870627272142592:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (6687us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969366.602058:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 30 00000100:00100000:2.0:1783969366.602069:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 31 00000100:00100000:2.0:1783969366.602075:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2350:x1870627272142464:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783969366.602097:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2350:x1870627272142464:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 22us (1646us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969366.602110:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 31 00000100:00080000:1.0:1783969366.602337:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783969366.602342:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783969366.602345:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1783969367.275192:0:10167:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1783969367.591554:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969368.615084:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969369.636963:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969369.701084:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280562560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969369.701153:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969369.701326:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280562560 00000100:00100000:1.0:1783969369.701334:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280562560 00000100:00100000:1.0:1783969369.701407:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783969369.701427:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280562560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783969369.701460:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783969369.701510:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280562560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969369.701517:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1783969369.701556:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7bf635c00 x1870627280562560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969369.701575:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280562560:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783969369.701700:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969370.213946:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280562688:0@lo:400:kworker.0 00000100:00100000:1.0:1783969370.214017:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969370.214024:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280563072:0@lo:400:kworker.0 00000100:00100000:0.0:1783969370.214054:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969370.214071:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac787780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1870627280563200:0@lo:400:kworker.0 00000100:00100000:0.0:1783969370.214071:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783969370.214076:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1870627280562944:0@lo:400:kworker.0 00000100:00100000:0.0:1783969370.214094:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969370.214104:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280562688 00000100:00100000:0.0:1783969370.214125:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969370.214143:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783969370.214148:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280562816:0@lo:400:kworker.0 00000100:00100000:0.0:1783969370.214168:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969370.214182:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac787782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280563328:0@lo:400:kworker.0 00000100:00100000:0.0:1783969370.214201:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969370.214220:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280563072 00000100:00100000:2.0:1783969370.214225:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280563072 00000100:00100000:0.0:1783969370.214232:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280562944 00000100:00100000:0.0:1783969370.214234:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280562944 00000100:00100000:2.0:1783969370.214262:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280563328 00000100:00100000:0.0:1783969370.214263:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280563200 00000100:00100000:2.0:1783969370.214265:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280563328 00000100:00100000:0.0:1783969370.214265:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280563200 00000100:00100000:0.0:1783969370.214278:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280562816 00000100:00100000:0.0:1783969370.214281:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280562816 00000100:00100000:0.0:1783969370.214293:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783969370.214294:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783969370.214300:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1870627280562944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969370.214301:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280563072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969370.214347:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280563072:12345-0@lo:400:kworker.0 Request processed in 47us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969370.214354:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783969370.214370:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783969370.214376:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280563328:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783969370.214393:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783969370.214398:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969370.214412:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783969370.214416:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280563328:12345-0@lo:400:kworker.0 Request processed in 42us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969370.214419:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1870627280563200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969370.214423:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783969370.214439:0:5794:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1783969370.214445:0:5794:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1783969370.214448:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1870627280563200:12345-0@lo:400:kworker.0 Request processed in 31us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969370.214454:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783969370.214467:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783969370.214473:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280562816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969370.214495:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280562816:12345-0@lo:400:kworker.0 Request processed in 23us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969370.214509:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783969370.214564:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280562816:0@lo:400:kworker.0 00010000:00080000:2.0:1783969370.214577:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac787782a00 x1870627280563328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969370.214587:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac787782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280563328:0@lo:400:kworker.0 00000100:00100000:2.0:1783969370.214596:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac787780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1870627280563200:0@lo:400:kworker.0 00000100:00100000:1.0:1783969370.215062:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280562688 00000100:00100000:0.0:1783969370.215068:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1870627280562944:12345-0@lo:400:kworker.0 Request processed in 768us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969370.215083:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783969370.215092:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1783969370.215098:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3287:x1870627280562688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969370.215622:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3287:x1870627280562688:12345-0@lo:400:kworker.0 Request processed in 521us (1603us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969370.215638:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1783969370.216265:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280562688:0@lo:400:kworker.0 00000100:00100000:3.0:1783969370.226041:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1870627280562944:0@lo:400:kworker.0 00010000:00080000:3.0:1783969370.226063:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac681f4df80 x1870627280563072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969370.226073:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280563072:0@lo:400:kworker.0 00010000:00010000:0.0:1783969370.665083:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969370.731344:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280563456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969370.731426:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969370.731496:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280563456 00000100:00100000:1.0:1783969370.731502:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280563456 00000100:00100000:1.0:1783969370.731542:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783969370.731550:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280563456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783969370.731580:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783969370.731620:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280563456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969370.731628:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1783969370.731664:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7bf635c00 x1870627280563456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969370.731682:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280563456:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783969371.687451:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969371.701659:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969371.701713:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969371.701737:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969371.701765:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272142720 00000100:00100000:3.0:1783969371.701774:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272142720 00000100:00100000:3.0:1783969371.701821:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 219 00000100:00100000:3.0:1783969371.701830:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2348:x1870627272142720:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969371.701912:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2348:x1870627272142720:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 82us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969371.701920:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 219 00000100:00100000:3.0:1783969371.701951:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272142976 00000100:00100000:3.0:1783969371.701955:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272142976 00000100:00100000:3.0:1783969371.701990:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 67 00000100:00100000:3.0:1783969371.701997:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2348:x1870627272142976:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969371.702029:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2348:x1870627272142976:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 32us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969371.702035:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 67 00000100:00100000:3.0:1783969371.702053:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272143232 00000100:00100000:3.0:1783969371.702056:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272143232 00000100:00100000:3.0:1783969371.702097:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 34 00000100:00100000:3.0:1783969371.702104:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2348:x1870627272143232:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969371.702130:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2348:x1870627272143232:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 27us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969371.702136:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 34 00000100:00080000:3.0:1783969371.702246:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783969371.702251:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969371.704114:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969371.704148:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969371.704176:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272143104 00000100:00100000:3.0:1783969371.704183:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272143104 00000100:00100000:3.0:1783969371.704232:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 35 00000100:00100000:3.0:1783969371.704241:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2348:x1870627272143104:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969371.704295:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2348:x1870627272143104:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 55us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969371.704302:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 35 00000100:00080000:3.0:1783969371.704323:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969371.706730:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272142848 00000100:00100000:2.0:1783969371.706746:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272142848 00000100:00100000:2.0:1783969371.706812:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 68 00000100:00100000:2.0:1783969371.706822:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+6:2348:x1870627272142848:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783969371.706908:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+6:2348:x1870627272142848:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 86us (2800us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969371.706915:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 68 00000100:00080000:3.0:1783969371.707198:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783969372.716338:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969373.747899:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969374.772171:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969374.822996:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280563584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969374.823077:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969374.829996:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280563584 00000100:00100000:2.0:1783969374.830007:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280563584 00000100:00100000:2.0:1783969374.830071:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783969374.830082:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280563584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969374.830116:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783969374.830185:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280563584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (7107us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969374.830192:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1783969374.830214:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783969374.832022:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7bf635c00 x1870627280563584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969374.832047:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280563584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783969375.333150:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a787e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870627280563840:0@lo:400:kworker.0 00000100:00100000:2.0:1783969375.333225:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969375.333277:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a787fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280564352:0@lo:400:kworker.0 00000100:00100000:2.0:1783969375.333305:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969375.333342:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783969375.333918:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a787c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280564096:0@lo:400:kworker.0 00000100:00100000:2.0:1783969375.333936:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a787e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280563712:0@lo:400:kworker.0 00000100:00100000:1.0:1783969375.333960:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969375.334552:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969375.334577:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783969375.334588:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a787d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1870627280563968:0@lo:400:kworker.0 00000100:00100000:2.0:1783969375.334598:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a787ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1870627280564224:0@lo:400:kworker.0 00000100:00100000:1.0:1783969375.334634:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969375.334659:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280563840 00000100:00100000:2.0:1783969375.334668:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280563840 00000100:00100000:3.0:1783969375.334697:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280563712 00000100:00100000:3.0:1783969375.334704:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280563712 00000100:00100000:2.0:1783969375.334728:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280563968 00000100:00100000:2.0:1783969375.334733:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280563968 00000100:00100000:3.0:1783969375.334752:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1783969375.334763:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3288:x1870627280563712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969375.334813:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3288:x1870627280563712:12345-0@lo:400:kworker.0 Request processed in 52us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969375.334820:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1783969375.334957:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783969375.334979:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870627280563840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969375.335020:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870627280563840:12345-0@lo:400:kworker.0 Request processed in 54us (1796us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969375.335028:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783969375.335045:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783969375.335052:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1870627280563968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969375.335086:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1870627280563968:12345-0@lo:400:kworker.0 Request processed in 35us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969375.335093:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1783969375.335114:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969375.335139:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280564352 00000100:00100000:2.0:1783969375.335143:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280564352 00000100:00100000:2.0:1783969375.335173:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280564096 00000100:00100000:2.0:1783969375.335177:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280564096 00000100:00100000:2.0:1783969375.335197:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783969375.335203:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280564352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969375.335235:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280564352:12345-0@lo:400:kworker.0 Request processed in 32us (1930us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969375.335242:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783969375.335253:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783969375.335258:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280564096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969375.335286:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280564096:12345-0@lo:400:kworker.0 Request processed in 28us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969375.335299:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1783969375.335321:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783969375.335330:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969375.335384:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a787e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870627280563840:0@lo:400:kworker.0 00010000:00080000:2.0:1783969375.335399:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7a787fb80 x1870627280564352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969375.335410:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a787fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280564352:0@lo:400:kworker.0 00000100:00100000:2.0:1783969375.335432:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a787e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280563712:0@lo:400:kworker.0 00000100:00100000:2.0:1783969375.335455:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280564224 00000100:00100000:2.0:1783969375.335459:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280564224 00000100:00100000:2.0:1783969375.335503:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783969375.335508:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870627280564224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969375.335541:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870627280564224:12345-0@lo:400:kworker.0 Request processed in 33us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969375.335547:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1783969375.335554:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969375.335577:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a787ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1870627280564224:0@lo:400:kworker.0 00000100:00100000:1.0:1783969375.335990:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a787d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1870627280563968:0@lo:400:kworker.0 00010000:00080000:1.0:1783969375.336003:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7a787c700 x1870627280564096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969375.336012:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a787c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280564096:0@lo:400:kworker.0 00010000:00010000:3.0:1783969375.780981:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969375.845027:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783969375.845050:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280564480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783969375.845276:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969375.845377:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280564480 00000100:00100000:1.0:1783969375.845384:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280564480 00000100:00100000:1.0:1783969375.845435:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783969375.845445:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280564480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783969375.845477:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783969375.845522:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280564480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969375.845529:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1783969375.845639:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7bf634700 x1870627280564480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969375.845656:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280564480:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783969376.806658:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969376.823532:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969376.823566:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969376.823594:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969376.823614:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969376.823636:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969376.823675:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272143744 00000100:00100000:1.0:1783969376.823684:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272143744 00000100:00100000:1.0:1783969376.823752:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272143872 00000100:00100000:1.0:1783969376.823756:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272143872 00000100:00100000:1.0:1783969376.823779:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 38 00000100:00100000:1.0:1783969376.823790:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2348:x1870627272143744:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969376.823877:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2348:x1870627272143744:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 70us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969376.824016:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 38 00000100:00100000:1.0:1783969376.824034:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 39 00000100:00100000:1.0:1783969376.824041:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2348:x1870627272143872:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969376.824070:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2348:x1870627272143872:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 29us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969376.824076:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 39 00000100:00100000:1.0:1783969376.824094:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272143360 00000100:00100000:1.0:1783969376.824098:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272143360 00000100:00100000:1.0:1783969376.824124:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 221 00000100:00100000:1.0:1783969376.824130:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2348:x1870627272143360:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969376.824154:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2348:x1870627272143360:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969376.824160:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 221 00000100:00100000:1.0:1783969376.824186:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272143488 00000100:00100000:1.0:1783969376.824189:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272143488 00000100:00100000:1.0:1783969376.824213:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272143616 00000100:00100000:1.0:1783969376.824216:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272143616 00000100:00100000:1.0:1783969376.824236:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 72 00000100:00100000:1.0:1783969376.824242:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+6:2348:x1870627272143488:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969376.824269:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf636a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+6:2348:x1870627272143488:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 28us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969376.824275:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 72 00000100:00100000:1.0:1783969376.824286:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 73 00000100:00100000:1.0:1783969376.824292:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2348:x1870627272143616:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969376.824324:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf637480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2348:x1870627272143616:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 32us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969376.824330:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 73 00000100:00080000:1.0:1783969376.824359:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783969376.824364:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783969376.824366:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783969377.841534:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969378.854455:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969379.877141:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969379.941476:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783969379.941499:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280564608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783969379.941562:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969379.941707:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280564608 00000100:00100000:1.0:1783969379.941715:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280564608 00000100:00100000:1.0:1783969379.941790:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783969379.941801:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280564608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783969379.941837:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783969379.941916:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280564608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969379.941924:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1783969379.941952:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783969379.941995:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7bf634700 x1870627280564608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969379.942013:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280564608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969380.453507:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280564992:0@lo:400:kworker.0 00000100:00100000:3.0:1783969380.453567:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969380.453747:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280564736:0@lo:400:kworker.0 00000100:00100000:1.0:1783969380.453791:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969380.453815:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969380.453821:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280564864:0@lo:400:kworker.0 00000100:00100000:1.0:1783969380.453842:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969380.453886:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280564992 00000100:00100000:1.0:1783969380.453893:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280564992 00000100:00100000:1.0:1783969380.453940:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280564864 00000100:00100000:1.0:1783969380.453943:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280564864 00000100:00100000:1.0:1783969380.453959:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783969380.453967:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280564992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969380.454010:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280564992:12345-0@lo:400:kworker.0 Request processed in 43us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969380.454027:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783969380.454043:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783969380.454048:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280564864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969380.454079:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280564864:12345-0@lo:400:kworker.0 Request processed in 31us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969380.454084:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783969380.454100:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280564736 00000100:00100000:1.0:1783969380.454103:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280564736 00000100:00100000:1.0:1783969380.454139:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1783969380.454144:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+19:3287:x1870627280564736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969380.454170:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+19:3287:x1870627280564736:12345-0@lo:400:kworker.0 Request processed in 26us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969380.454176:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:1.0:1783969380.454201:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969380.454236:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280564864:0@lo:400:kworker.0 00000100:00100000:1.0:1783969380.454245:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280564736:0@lo:400:kworker.0 00000100:00100000:3.0:1783969380.454543:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969380.454554:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1870627280565120:0@lo:400:kworker.0 00000100:00100000:3.0:1783969380.454583:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969380.454617:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280564992:0@lo:400:kworker.0 00000100:00100000:2.0:1783969380.454908:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783969380.454918:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280565248:0@lo:400:kworker.0 00000100:00100000:2.0:1783969380.454950:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969380.455029:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280565120 00000100:00100000:1.0:1783969380.455034:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280565120 00000100:00100000:1.0:1783969380.455073:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783969380.455079:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1870627280565120:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783969380.455185:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969380.455220:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1870627280565120:12345-0@lo:400:kworker.0 Request processed in 141us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969380.455227:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783969380.455258:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1870627280565120:0@lo:400:kworker.0 00000100:00100000:3.0:1783969380.455338:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280565248 00000100:00100000:3.0:1783969380.455342:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280565248 00000100:00100000:3.0:1783969380.455386:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783969380.455392:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280565248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969380.455426:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280565248:12345-0@lo:400:kworker.0 Request processed in 34us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969380.455431:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1783969380.455482:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783969380.455502:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7bf6d5c00 x1870627280565248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969380.455522:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280565248:0@lo:400:kworker.0 00010000:00010000:2.0:1783969380.902248:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969380.965047:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969380.965070:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280565376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783969380.965146:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969380.965287:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280565376 00000100:00100000:1.0:1783969380.965294:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280565376 00000100:00100000:1.0:1783969380.965349:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783969380.965358:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280565376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783969380.965387:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783969380.965428:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280565376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969380.965435:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1783969380.965508:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7bf635f80 x1870627280565376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969380.965536:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280565376:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783969381.925954:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969381.948789:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969381.948844:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969381.948890:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272144000 00000100:00100000:3.0:1783969381.948899:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272144000 00000100:00100000:3.0:1783969381.948954:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 223 00000100:00100000:3.0:1783969381.948965:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2348:x1870627272144000:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969381.949030:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2348:x1870627272144000:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 66us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969381.949036:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 223 00000100:00100000:2.0:1783969381.950283:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272144128 00000100:00100000:2.0:1783969381.950291:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272144128 00000100:00100000:2.0:1783969381.950365:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 77 00000100:00100000:2.0:1783969381.950375:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+6:2349:x1870627272144128:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783969381.950438:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf635180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+6:2349:x1870627272144128:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 65us (1594us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969381.950445:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 77 00000100:00080000:1.0:1783969381.950651:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969381.957009:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969381.957054:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969381.957087:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969381.957242:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272144384 00000100:00100000:2.0:1783969381.957251:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272144384 00000100:00100000:2.0:1783969381.957304:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272144512 00000100:00100000:2.0:1783969381.957317:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272144512 00000100:00100000:2.0:1783969381.957342:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 14 00000100:00100000:2.0:1783969381.957351:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2347:x1870627272144384:12345-192.168.203.39@tcp:9:kworker.0 00000020:00000080:2.0:1783969381.957377:0:6593:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faadf0 00000100:00080000:2.0:1783969381.957384:0:6593:0:(import.c:65:import_set_state_nolock()) ffff9ac7861de000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783969381.957417:0:6593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1783969381.957726:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+2:2347:x1870627272144384:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 375us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969381.957733:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 14 00000100:00100000:2.0:1783969381.957748:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00100000:2.0:1783969381.957755:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2347:x1870627272144512:12345-192.168.203.39@tcp:9:kworker.0 00000020:00000080:2.0:1783969381.957766:0:6593:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faadf7 00000100:00080000:2.0:1783969381.957771:0:6593:0:(import.c:65:import_set_state_nolock()) ffff9ac7861dd800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783969381.957807:0:6593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1783969381.958036:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba269c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+2:2347:x1870627272144512:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 279us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969381.958042:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 15 00010000:00010000:2.0:1783969381.958400:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969381.958406:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783969381.958571:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783969381.958576:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783969381.959847:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272144256 00000100:00100000:0.0:1783969381.959870:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272144256 00000100:00100000:0.0:1783969381.960030:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 78 00000100:00100000:0.0:1783969381.960041:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2348:x1870627272144256:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969381.962070:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf634700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2348:x1870627272144256:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 2022us (4971us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969381.962082:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 78 00000100:00080000:1.0:1783969381.963604:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783969382.949455:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783969383.588516:0:7494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4af233ee-6a25-4eaf-90cc-2e5dc362fbb6 00000020:00000080:0.0:1783969383.588526:0:7494:0:(genops.c:906:class_export_put()) final put ffff9ac7861d8000/4af233ee-6a25-4eaf-90cc-2e5dc362fbb6 00000020:00000080:0.0:1783969383.588556:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7861d8000/4af233ee-6a25-4eaf-90cc-2e5dc362fbb6 for lustre-OST0001 00000020:00000080:0.0:1783969383.588597:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ac7861dd800 for lustre-OST0001 00000001:02000400:1.0:1783969383.657114:0:10871:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1783969383.975825:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969384.997408:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969385.067400:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783969385.067424:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280565504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783969385.067496:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969385.070355:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280565504 00000100:00100000:1.0:1783969385.070370:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280565504 00000100:00100000:1.0:1783969385.070429:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783969385.070439:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280565504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783969385.070480:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783969385.070555:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280565504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (3058us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969385.070562:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1783969385.070583:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783969385.070614:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7bf635c00 x1870627280565504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969385.070642:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280565504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969385.582323:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280565632:0@lo:400:kworker.0 00000100:00100000:3.0:1783969385.582397:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969385.582441:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280566144:0@lo:400:kworker.0 00000100:00100000:3.0:1783969385.582465:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969385.582488:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783969385.582493:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1870627280566016:0@lo:400:kworker.0 00000100:00100000:3.0:1783969385.582514:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969385.582536:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280565760:0@lo:400:kworker.0 00000100:00100000:3.0:1783969385.582556:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969385.582572:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969385.582576:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280565888:0@lo:400:kworker.0 00000100:00100000:3.0:1783969385.582596:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969385.582626:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280565632 00000100:00100000:3.0:1783969385.582633:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280565632 00000100:00100000:3.0:1783969385.582680:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1783969385.582688:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:3286:x1870627280565632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969385.582737:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:3286:x1870627280565632:12345-0@lo:400:kworker.0 Request processed in 50us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969385.582744:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1783969385.582774:0:9934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280566144 00000100:00100000:3.0:1783969385.582778:0:9934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280566144 00000100:00100000:3.0:1783969385.582814:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783969385.582820:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280566144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969385.582851:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280566144:12345-0@lo:400:kworker.0 Request processed in 31us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969385.582874:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783969385.582893:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280566016 00000100:00100000:3.0:1783969385.582896:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280566016 00000100:00100000:3.0:1783969385.582920:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280565760 00000100:00100000:3.0:1783969385.582923:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280565760 00000100:00100000:3.0:1783969385.582938:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280565888 00000100:00100000:3.0:1783969385.582941:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280565888 00000100:00100000:3.0:1783969385.582955:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783969385.582961:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1870627280566016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969385.582990:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1870627280566016:12345-0@lo:400:kworker.0 Request processed in 29us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969385.582996:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1783969385.583007:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783969385.583012:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280565760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969385.583042:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280565760:12345-0@lo:400:kworker.0 Request processed in 30us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969385.583058:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783969385.583070:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783969385.583076:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280565888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969385.583105:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280565888:12345-0@lo:400:kworker.0 Request processed in 30us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969385.583111:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1783969385.583136:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783969385.583140:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783969385.583175:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280565888:0@lo:400:kworker.0 00000100:00100000:3.0:1783969385.583187:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280565760:0@lo:400:kworker.0 00000100:00100000:3.0:1783969385.583215:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1870627280566016:0@lo:400:kworker.0 00000100:00100000:3.0:1783969385.583223:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280565632:0@lo:400:kworker.0 00010000:00080000:3.0:1783969385.583233:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7bf6d5500 x1870627280566144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969385.583244:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280566144:0@lo:400:kworker.0 00010000:00010000:3.0:1783969386.021944:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969386.085101:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783969386.085123:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280566272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969386.085187:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969386.085244:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280566272 00000100:00100000:1.0:1783969386.085251:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280566272 00000100:00100000:1.0:1783969386.085306:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783969386.085315:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280566272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783969386.085348:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783969386.085395:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280566272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969386.085402:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1783969386.085442:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7bf635c00 x1870627280566272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969386.085461:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280566272:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1783969386.706067:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4af233ee-6a25-4eaf-90cc-2e5dc362fbb6 00000020:00000080:0.0:1783969386.706170:0:6622:0:(genops.c:906:class_export_put()) final put ffff9ac7861de800/4af233ee-6a25-4eaf-90cc-2e5dc362fbb6 00000020:00000080:1.0:1783969386.708249:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7861de800/4af233ee-6a25-4eaf-90cc-2e5dc362fbb6 for lustre-OST0000 00000020:00000080:2.0:1783969386.709363:0:483:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ac7861de000 for lustre-OST0000 00010000:00010000:2.0:1783969387.045012:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969387.076375:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969387.076416:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969387.076450:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969387.076533:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272144896 00000100:00100000:0.0:1783969387.076556:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272144896 00000100:00100000:0.0:1783969387.076621:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272144768 00000100:00100000:0.0:1783969387.076624:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272144768 00000100:00100000:0.0:1783969387.076649:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 82 00000100:00100000:0.0:1783969387.076659:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2351:x1870627272144896:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969387.076734:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2351:x1870627272144896:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 76us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969387.076742:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 82 00000100:00100000:0.0:1783969387.076758:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 83 00000100:00100000:0.0:1783969387.076779:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+6:2351:x1870627272144768:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969387.076804:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+6:2351:x1870627272144768:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 27us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969387.076809:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 83 00000100:00100000:1.0:1783969387.077114:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272144640 00000100:00100000:1.0:1783969387.077119:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272144640 00000100:00100000:1.0:1783969387.077149:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 225 00000100:00100000:1.0:1783969387.077155:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2351:x1870627272144640:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969387.077202:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2351:x1870627272144640:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 46us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969387.077208:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 225 00000100:00080000:2.0:1783969387.077369:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1783969387.512192:0:11020:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf6ba1cc0 20000000:00000080:0.0:1783969387.512209:0:11020:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ac7c1b93800 uarg=0000000000000000 20000000:01000000:0.0:1783969387.512245:0:11020:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783969387.512250:0:11020:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783969387.512254:0:11020:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783969387.513304:0:11021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1783969387.513457:0:11020:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1783969387.522706:0:11020:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783969387.522843:0:11020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac7bfb92c00/0xbacf56d076faadfe lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969387.523359:0:11020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac7c21e3a00/0xbacf56d076faada3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63046 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969387.523371:0:11020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac783de6800/0xbacf56d076faadb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faadaa expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969387.523394:0:11020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac783de7a00/0xbacf56d076faadbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faadb8 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969387.523401:0:11020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac783de6000/0xbacf56d076faadcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faadc6 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969387.523409:0:11020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac7bfb93600/0xbacf56d076faade2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6307e expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969387.523416:0:11020:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ac7bfb92c00/0xbacf56d076faadfe lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969387.523456:0:11020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac7bfb93600/0xbacf56d076faade2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6307e expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969387.523472:0:11020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac7bfb93600/0xbacf56d076faade2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6307e expref: 12 pid: 5787 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969387.523486:0:11020:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac787780a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1870627280566400:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783969387.523590:0:11020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac783de6000/0xbacf56d076faadcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faadc6 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969387.523599:0:11020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac783de6000/0xbacf56d076faadcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faadc6 expref: 18 pid: 5788 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969387.523609:0:11020:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac787783800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1870627280566528:0@lo:104: 00000100:00100000:0.0:1783969387.525052:0:11020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783969387.525125:0:11020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac783de7a00/0xbacf56d076faadbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faadb8 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969387.525150:0:11020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac783de7a00/0xbacf56d076faadbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faadb8 expref: 18 pid: 5788 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969387.525162:0:11020:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac787781f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1870627280566656:0@lo:104: 00000100:00100000:0.0:1783969387.525195:0:11020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783969387.525233:0:11020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac783de6800/0xbacf56d076faadb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faadaa expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969387.525242:0:11020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac783de6800/0xbacf56d076faadb1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faadaa expref: 18 pid: 5786 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969387.525251:0:11020:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac787781880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1870627280566784:0@lo:104: 00000100:00100000:0.0:1783969387.525282:0:11020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783969387.525308:0:11020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac7c21e3a00/0xbacf56d076faada3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63046 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969387.525317:0:11020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac7c21e3a00/0xbacf56d076faada3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63046 expref: 12 pid: 5787 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969387.525327:0:11020:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac787782680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1870627280566912:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783969387.525404:0:11020:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba60b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969387.525474:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280566528 00000100:00100000:1.0:1783969387.525482:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280566528 00000100:00100000:1.0:1783969387.525513:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280566656 00000100:00100000:1.0:1783969387.525516:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280566656 00000100:00100000:1.0:1783969387.525523:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280566784 00000100:00100000:1.0:1783969387.525525:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280566784 00000100:00100000:1.0:1783969387.525536:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783969387.525543:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787781500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c893ad09-f78f-4711-bea5-6489668294ed+5:11020:x1870627280566528:12345-0@lo:104: 00010000:00010000:1.0:1783969387.525554:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac783de7800/0xbacf56d076faadc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faadcd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.525619:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783969387.525633:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787781500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c893ad09-f78f-4711-bea5-6489668294ed+5:11020:x1870627280566528:12345-0@lo:104: Request processed in 82us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969387.525639:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783969387.525653:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783969387.525658:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787780e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c893ad09-f78f-4711-bea5-6489668294ed+4:11020:x1870627280566656:12345-0@lo:104: 00010000:00010000:1.0:1783969387.525665:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac783de7600/0xbacf56d076faadb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faadbf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.525694:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783969387.525698:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787780e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c893ad09-f78f-4711-bea5-6489668294ed+4:11020:x1870627280566656:12345-0@lo:104: Request processed in 41us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969387.525703:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783969387.525713:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783969387.525717:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787781c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c893ad09-f78f-4711-bea5-6489668294ed+3:11020:x1870627280566784:12345-0@lo:104: 00010000:00010000:1.0:1783969387.525724:0:5777:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac781496800/0xbacf56d076faadaa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faadb1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.525759:0:5777:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783969387.525763:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787781c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c893ad09-f78f-4711-bea5-6489668294ed+3:11020:x1870627280566784:12345-0@lo:104: Request processed in 46us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969387.525769:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1783969387.525782:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783969387.525787:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac783de7800/0xbacf56d076faadc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faadcd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.525794:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de7800 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:1.0:1783969387.525798:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac783de7800/0xbacf56d076faadc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faadcd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.525805:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac783de7800/0xbacf56d076faadc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faadcd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783969387.525812:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac783de7800/0xbacf56d076faadc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faadcd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969387.525818:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783969387.525845:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac783de7800/0xbacf56d076faadc6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faadcd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.525851:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783969387.525896:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac783de7800/0xbacf56d076faadc6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faadcd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.525904:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac783de7800/0xbacf56d076faadc6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faadcd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.525927:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783969387.525930:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac783de7600/0xbacf56d076faadb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faadbf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.525935:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de7600 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:1.0:1783969387.525939:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac783de7600/0xbacf56d076faadb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faadbf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.525945:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac783de7600/0xbacf56d076faadb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faadbf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783969387.525951:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac783de7600/0xbacf56d076faadb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faadbf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969387.525955:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783969387.525969:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac783de7600/0xbacf56d076faadb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faadbf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.525975:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783969387.525990:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac783de7600/0xbacf56d076faadb8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faadbf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.525996:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac783de7600/0xbacf56d076faadb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faadbf expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.526005:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969387.526008:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac781496800/0xbacf56d076faadaa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faadb1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.526022:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac781496800 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:1.0:1783969387.526025:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac781496800/0xbacf56d076faadaa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faadb1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.526032:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac781496800/0xbacf56d076faadaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faadb1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783969387.526038:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac781496800/0xbacf56d076faadaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faadb1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969387.526043:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783969387.526056:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac781496800/0xbacf56d076faadaa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faadb1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.526061:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783969387.526068:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac781496800/0xbacf56d076faadaa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faadb1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.526075:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac781496800/0xbacf56d076faadaa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faadb1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.526087:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969387.526089:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969387.526090:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969387.526097:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969387.526114:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280567040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783969387.526158:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969387.526189:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280567168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783969387.526221:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969387.526239:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969387.526245:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280567296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783969387.526263:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969387.526301:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280567040 00000100:00100000:1.0:1783969387.526305:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280567040 00010000:00010000:1.0:1783969387.526323:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac783de6000/0xbacf56d076faadcd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faadc6 expref: 19 pid: 5788 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969387.526341:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280567168 00000100:00100000:1.0:1783969387.526344:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280567168 00010000:00010000:1.0:1783969387.526353:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac783de7a00/0xbacf56d076faadbf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faadb8 expref: 20 pid: 5788 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969387.526362:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280567296 00000100:00100000:1.0:1783969387.526364:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280567296 00010000:00010000:1.0:1783969387.526371:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac783de6800/0xbacf56d076faadb1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faadaa expref: 21 pid: 5786 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969387.526382:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783969387.526388:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a63450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c893ad09-f78f-4711-bea5-6489668294ed+21:3288:x1870627280567040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783969387.526398:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969387.526403:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac783de6000/0xbacf56d076faadcd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faadc6 expref: 21 pid: 5788 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.526412:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac783de6000/0xbacf56d076faadcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faadc6 expref: 21 pid: 5788 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.526426:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969387.526452:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a63450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c893ad09-f78f-4711-bea5-6489668294ed+21:3288:x1870627280567040:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969387.526464:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783969387.526509:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783969387.526515:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785317b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c893ad09-f78f-4711-bea5-6489668294ed+20:3285:x1870627280567168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783969387.526523:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969387.526527:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac783de7a00/0xbacf56d076faadbf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faadb8 expref: 20 pid: 5788 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.526534:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac783de7a00/0xbacf56d076faadbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faadb8 expref: 20 pid: 5788 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.526543:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969387.526569:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785317b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c893ad09-f78f-4711-bea5-6489668294ed+20:3285:x1870627280567168:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969387.526575:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783969387.526587:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783969387.526593:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785314000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c893ad09-f78f-4711-bea5-6489668294ed+19:3285:x1870627280567296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783969387.526600:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969387.526604:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac783de6800/0xbacf56d076faadb1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faadaa expref: 19 pid: 5786 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.526612:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac783de6800/0xbacf56d076faadb1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faadaa expref: 19 pid: 5786 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.526620:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969387.526640:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785314000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c893ad09-f78f-4711-bea5-6489668294ed+19:3285:x1870627280567296:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969387.526646:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783969387.526679:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280567040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783969387.526709:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280567296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783969387.526716:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280567168:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783969387.527183:0:11020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac783de6000/0xbacf56d076faadcd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faadc6 expref: 18 pid: 5788 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969387.527197:0:11020:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac787783800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1870627280566528:0@lo:104: 00010000:00010000:0.0:1783969387.527206:0:11020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac783de7a00/0xbacf56d076faadbf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faadb8 expref: 17 pid: 5788 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969387.527225:0:11020:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac787781f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1870627280566656:0@lo:104: 00010000:00010000:0.0:1783969387.527235:0:11020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac783de6800/0xbacf56d076faadb1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faadaa expref: 16 pid: 5786 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969387.527242:0:11020:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac787781880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1870627280566784:0@lo:104: 00010000:00010000:2.0:1783969387.528959:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969387.533431:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969387.533472:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969387.533545:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272145024 00000100:00100000:1.0:1783969387.533555:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272145024 00010000:00010000:1.0:1783969387.533600:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac7bfb93600/0xbacf56d076faade2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6307e expref: 13 pid: 5787 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969387.533640:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272145152 00000100:00100000:1.0:1783969387.533643:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272145152 00010000:00010000:1.0:1783969387.533654:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac7c21e3a00/0xbacf56d076faada3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63046 expref: 14 pid: 5787 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969387.533676:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 28 00000100:00100000:1.0:1783969387.533684:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787780380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+14:2351:x1870627272145024:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969387.533698:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969387.533703:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac7bfb93600/0xbacf56d076faade2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6307e expref: 14 pid: 5787 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.533726:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac7bfb93600/0xbacf56d076faade2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6307e expref: 14 pid: 5787 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.533746:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969387.533791:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787780380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+14:2351:x1870627272145024:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 107us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969387.533798:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 28 00000100:00100000:1.0:1783969387.533819:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 29 00000100:00100000:1.0:1783969387.533825:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787782300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2350:x1870627272145152:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969387.533846:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969387.533851:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac7c21e3a00/0xbacf56d076faada3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63046 expref: 13 pid: 5787 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.533885:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac7c21e3a00/0xbacf56d076faada3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63046 expref: 13 pid: 5787 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.533898:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ac7bfb92c00/0xbacf56d076faadfe lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.533906:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7bfb92c00/0xbacf56d076faadfe lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.533921:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac7bfb92c00/0xbacf56d076faadfe lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.533929:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac7bfb92c00/0xbacf56d076faadfe lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.533936:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac7bfb92c00/0xbacf56d076faadfe lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.533943:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac7bfb92c00/0xbacf56d076faadfe lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.533949:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92c00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969387.533954:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac7bfb92c00/0xbacf56d076faadfe lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.533961:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac7bfb92c00/0xbacf56d076faadfe lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.533979:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac7bfb92c00/0xbacf56d076faadfe lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969387.533989:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969387.534008:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787782300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2350:x1870627272145152:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 182us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969387.534014:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 29 00010000:00010000:2.0:1783969387.535408:0:11020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7bfb93600/0xbacf56d076faade2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6307e expref: 12 pid: 5787 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969387.535425:0:11020:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac787780a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1870627280566400:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969387.535439:0:11020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7c21e3a00/0xbacf56d076faada3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63046 expref: 11 pid: 5787 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969387.535448:0:11020:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac787782680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1870627280566912:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969387.535478:0:11020:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ac7bfb92c00/0xbacf56d076faadfe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969387.535486:0:11020:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ac7bfb92c00/0xbacf56d076faadfe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969387.535505:0:11020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac7bfb92c00/0xbacf56d076faadfe lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969387.535511:0:11020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7bfb92c00/0xbacf56d076faadfe lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969388.070115:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783969388.581023:0:5790:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783969388.581031:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ac7bf7a8800 from 7 10000000:01000000:1.0:1783969388.581036:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783969388.581106:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faae05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969388.581119:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faae05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969388.581130:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faae05 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969388.581158:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785317800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280567424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783969388.581228:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969388.581289:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7877673c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969388.581611:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280567424 00000100:00100000:3.0:1783969388.581618:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280567424 00000100:00100000:3.0:1783969388.581669:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1783969388.581678:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+16:5790:x1870627280567424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969388.581690:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969388.581703:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac783de6a00/0xbacf56d076faae0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faae05 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969388.581743:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac783de6a00/0xbacf56d076faae0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faae05 expref: 17 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969388.581753:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac783de6a00/0xbacf56d076faae0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faae05 expref: 17 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969388.581761:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de6a00, rc 0) 00000100:00100000:3.0:1783969388.581799:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280567424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969388.581805:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1783969388.581898:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785317800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280567424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969388.581912:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faae05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faae0c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969388.581921:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faae05 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faae0c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969388.581974:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac787782680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280567552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969388.581999:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969388.582020:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba60b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969388.582115:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280567552 00000100:00100000:1.0:1783969388.582119:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280567552 00000100:00100000:1.0:1783969388.582141:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1783969388.582147:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280567552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969388.582384:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280567552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969388.582397:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1783969388.582711:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac787782680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280567552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969388.582745:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a787e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280567680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969388.582787:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969388.582811:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac78567b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969388.582889:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280567680 00000100:00100000:0.0:1783969388.582893:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280567680 00000100:00100000:0.0:1783969388.582916:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1783969388.582922:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280567680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783969388.583070:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280567680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969388.583077:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1783969388.583162:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a787e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280567680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783969388.584468:0:11051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783969388.584992:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783969388.585029:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783969388.585039:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faae05 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faae0c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969388.585051:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faae05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faae0c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969388.585070:0:5790:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783969388.585072:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ac7ba5f7000 from 7 10000000:01000000:0.0:1783969388.585075:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783969388.586424:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb92400/0xbacf56d076faae13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969388.586439:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb92400/0xbacf56d076faae13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969388.586450:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb92400/0xbacf56d076faae13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969388.586476:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac787780a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280567808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783969388.586539:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969388.586583:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba60bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783969388.586717:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280567808 00000100:00100000:3.0:1783969388.586724:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280567808 00000100:00100000:3.0:1783969388.586767:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1783969388.586776:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280567808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969388.586789:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969388.586802:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac783de7e00/0xbacf56d076faae1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faae13 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969388.586824:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac783de7e00/0xbacf56d076faae1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faae13 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969388.586835:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac783de7e00/0xbacf56d076faae1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faae13 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969388.586843:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7e00, rc 0) 00000100:00100000:3.0:1783969388.586905:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280567808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969388.586912:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1783969388.587584:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac787780a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280567808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969388.587603:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb92400/0xbacf56d076faae13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faae1a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969388.587613:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb92400/0xbacf56d076faae13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faae1a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969388.587689:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac787780a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280567936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969388.587731:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969388.587764:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba60bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783969388.588421:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280567936 00000100:00100000:3.0:1783969388.588429:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280567936 00000100:00100000:3.0:1783969388.588475:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1783969388.588484:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280567936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969388.588784:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280567936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 298us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969388.588792:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1783969388.589476:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac787780a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280567936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969388.589536:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac787780a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280568064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783969388.589603:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969388.589640:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba60bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969388.590102:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280568064 00000100:00100000:1.0:1783969388.590110:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280568064 00000100:00100000:1.0:1783969388.590151:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1783969388.590160:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280568064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969388.590362:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280568064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969388.590369:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1783969388.590566:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac787780a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280568064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783969388.599503:0:11052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783969388.603687:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783969388.603722:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783969388.603732:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb92400/0xbacf56d076faae13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faae1a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969388.603803:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb92400/0xbacf56d076faae13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faae1a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969388.603819:0:5790:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783969388.603822:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ac783021000 from 7 10000000:01000000:1.0:1783969388.603824:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783969388.605098:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781496c00/0xbacf56d076faae21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969388.605111:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac781496c00/0xbacf56d076faae21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969388.605121:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac781496c00/0xbacf56d076faae21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969388.605147:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280568192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783969388.605251:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969388.605296:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac78385c840 going to sleep for 11 seconds 00000100:00100000:0.0:1783969388.605509:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280568192 00000100:00100000:0.0:1783969388.605527:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280568192 00000100:00100000:0.0:1783969388.605584:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1783969388.605594:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280568192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969388.605607:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969388.605620:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7bfb93000/0xbacf56d076faae28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faae21 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969388.605642:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7bfb93000/0xbacf56d076faae28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faae21 expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969388.605652:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7bfb93000/0xbacf56d076faae28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faae21 expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969388.605659:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93000, rc 0) 00000100:00100000:0.0:1783969388.605709:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:5790:x1870627280568192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969388.605715:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1783969388.605888:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280568192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969388.605905:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac781496c00/0xbacf56d076faae21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faae28 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969388.605914:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac781496c00/0xbacf56d076faae21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faae28 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969388.605968:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a787e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280568320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969388.605998:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969388.606013:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac78567b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969388.606076:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280568320 00000100:00100000:3.0:1783969388.606081:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280568320 00000100:00100000:3.0:1783969388.606117:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1783969388.606124:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:5790:x1870627280568320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969388.606379:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:5790:x1870627280568320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969388.606385:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1783969388.606505:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a787e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280568320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969388.606534:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a787e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280568448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969388.606583:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969388.606611:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac78567b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969388.606758:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280568448 00000100:00100000:3.0:1783969388.606763:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280568448 00000100:00100000:3.0:1783969388.606783:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1783969388.606788:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:5790:x1870627280568448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969388.606959:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:5790:x1870627280568448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969388.606966:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1783969388.607220:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a787e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280568448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783969388.608725:0:11053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783969388.609278:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783969388.609298:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783969388.609308:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781496c00/0xbacf56d076faae21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faae28 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969388.609320:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac781496c00/0xbacf56d076faae21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faae28 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969388.984532:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969388.984797:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272145280 00000100:00100000:3.0:1783969388.984806:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272145280 00000100:00100000:3.0:1783969388.984929:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 235 00000100:00100000:3.0:1783969388.984939:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+11:5581:x1870627272145280:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969388.984956:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969388.984975:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac783de7400/0xbacf56d076faae2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb630a8 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969388.985001:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac783de7400/0xbacf56d076faae2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630a8 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969388.985012:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac783de7400/0xbacf56d076faae2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630a8 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969388.985020:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7400, rc 0) 00000100:00100000:3.0:1783969388.985084:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+12:5581:x1870627272145280:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 Request processed in 147us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969388.985091:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 235 00000100:00100000:0.0:1783969389.000731:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969389.004428:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272145408 00000100:00100000:3.0:1783969389.004440:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272145408 00000100:00100000:3.0:1783969389.004497:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 236 00000100:00100000:3.0:1783969389.004506:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+12:5581:x1870627272145408:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969389.004778:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+12:5581:x1870627272145408:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 Request processed in 271us (4052us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969389.004787:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 236 00000100:00100000:0.0:1783969389.010692:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969389.012631:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272145536 00000100:00100000:3.0:1783969389.012645:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272145536 00000100:00100000:3.0:1783969389.012704:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 237 00000100:00100000:3.0:1783969389.012713:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+12:5581:x1870627272145536:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969389.012932:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+12:5581:x1870627272145536:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 Request processed in 217us (2247us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969389.012940:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 237 00000100:00100000:0.0:1783969389.042136:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969389.042294:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272145664 00000100:00100000:3.0:1783969389.042304:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272145664 00000100:00100000:3.0:1783969389.042358:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 238 00000100:00100000:3.0:1783969389.042368:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+12:5581:x1870627272145664:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969389.042384:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969389.042404:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac783de7600/0xbacf56d076faae36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb630af expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969389.042432:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac783de7600/0xbacf56d076faae36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630af expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969389.042443:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac783de7600/0xbacf56d076faae36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630af expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969389.042452:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7600, rc 0) 00000100:00100000:3.0:1783969389.042520:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:5581:x1870627272145664:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 Request processed in 153us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969389.042527:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 238 00000100:00100000:3.0:1783969389.045437:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969389.045578:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272145792 00000100:00100000:1.0:1783969389.045587:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272145792 00000100:00100000:1.0:1783969389.045644:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 239 00000100:00100000:1.0:1783969389.045655:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:5581:x1870627272145792:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969389.046016:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:5581:x1870627272145792:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 Request processed in 361us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969389.046024:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 239 00000100:00100000:3.0:1783969389.050570:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969389.050763:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272145920 00000100:00100000:2.0:1783969389.050774:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272145920 00000100:00100000:2.0:1783969389.050828:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 240 00000100:00100000:2.0:1783969389.050838:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:5581:x1870627272145920:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969389.051884:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:5581:x1870627272145920:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 Request processed in 1042us (1317us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969389.051894:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 240 00010000:00010000:1.0:1783969389.093041:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969390.118915:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969390.181229:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac787781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280568576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783969390.181313:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969390.181449:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280568576 00000100:00100000:0.0:1783969390.181457:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280568576 00000100:00100000:0.0:1783969390.181515:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783969390.181524:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280568576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783969390.181559:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783969390.181605:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280568576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969390.181612:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1783969390.181650:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac787781880 x1870627280568576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969390.181667:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac787781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280568576:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783969390.181924:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969390.693106:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1870627280569088:0@lo:400:kworker.0 00000100:00100000:1.0:1783969390.693221:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280568704:0@lo:400:kworker.0 00000100:00100000:1.0:1783969390.693270:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969390.693317:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280569216:0@lo:400:kworker.0 00000100:00100000:1.0:1783969390.693346:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969390.693387:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280568704 00000100:00100000:1.0:1783969390.693394:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280568704 00000100:00100000:1.0:1783969390.693438:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1783969390.693447:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3288:x1870627280568704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969390.693496:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3288:x1870627280568704:12345-0@lo:400:kworker.0 Request processed in 50us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969390.693504:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1783969390.693533:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280569216 00000100:00100000:1.0:1783969390.693537:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280569216 00000100:00100000:1.0:1783969390.693574:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783969390.693581:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280569216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969390.693614:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280569216:12345-0@lo:400:kworker.0 Request processed in 34us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969390.693629:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1783969390.693644:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969390.693668:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280568704:0@lo:400:kworker.0 00010000:00080000:1.0:1783969390.693682:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7bf6d4000 x1870627280569216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969390.693694:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280569216:0@lo:400:kworker.0 00000100:00100000:1.0:1783969390.693732:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1870627280568832:0@lo:400:kworker.0 00000100:00100000:1.0:1783969390.693769:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1870627280568960:0@lo:400:kworker.0 00000100:00100000:3.0:1783969390.701894:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969390.701980:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969390.702091:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280569088 00000100:00100000:1.0:1783969390.702101:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280569088 00000100:00100000:1.0:1783969390.702152:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280568960 00000100:00100000:1.0:1783969390.702156:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280568960 00000100:00100000:1.0:1783969390.702180:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783969390.702189:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1870627280569088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969390.702276:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1870627280569088:12345-0@lo:400:kworker.0 Request processed in 88us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969390.702283:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783969390.702299:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783969390.702306:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1870627280568960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969390.702336:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681bf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1870627280568960:12345-0@lo:400:kworker.0 Request processed in 30us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969390.702357:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1783969390.702381:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969390.702721:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1870627280568960:0@lo:400:kworker.0 00000100:00100000:3.0:1783969390.702752:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969390.702804:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1870627280569088:0@lo:400:kworker.0 00000100:00100000:1.0:1783969390.702883:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280568832 00000100:00100000:1.0:1783969390.702897:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280568832 00000100:00100000:1.0:1783969390.702931:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783969390.702938:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1870627280568832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969390.702978:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1870627280568832:12345-0@lo:400:kworker.0 Request processed in 41us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969390.702985:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783969390.703215:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1870627280568832:0@lo:400:kworker.0 00010000:00010000:2.0:1783969391.141957:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969391.205065:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783969391.205090:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280569344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969391.205158:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969391.205327:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280569344 00000100:00100000:1.0:1783969391.205335:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280569344 00000100:00100000:1.0:1783969391.205386:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783969391.205395:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280569344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783969391.205429:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783969391.205479:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280569344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969391.205485:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1783969391.205521:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac785316680 x1870627280569344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969391.205540:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785316680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280569344:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1783969391.325478:0:11219:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783969392.165140:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969392.180771:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969392.180814:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969392.180825:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272146048 00000100:00100000:2.0:1783969392.180836:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272146048 00000100:00100000:3.0:1783969392.180849:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969392.180937:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 242 00000100:00100000:2.0:1783969392.180947:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2350:x1870627272146048:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783969392.181011:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2350:x1870627272146048:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 66us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969392.181018:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 242 00000100:00100000:0.0:1783969392.181112:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272146304 00000100:00100000:0.0:1783969392.181117:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272146304 00000100:00100000:1.0:1783969392.181145:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272146176 00000100:00100000:1.0:1783969392.181151:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272146176 00000100:00100000:0.0:1783969392.181181:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 87 00000100:00100000:0.0:1783969392.181192:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2350:x1870627272146304:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969392.181198:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 88 00000100:00100000:1.0:1783969392.181209:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+6:2350:x1870627272146176:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969392.181234:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2350:x1870627272146304:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 44us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969392.181241:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 87 00000100:00100000:1.0:1783969392.181259:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+6:2350:x1870627272146176:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 51us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969392.181267:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 88 00000100:00080000:2.0:1783969392.181551:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783969393.189456:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969394.223637:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783969395.033057:0:11318:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 15:03:13 (1783969393) === 00010000:00010000:1.0:1783969395.243130:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969395.265761:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969395.265814:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969395.265832:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272146432 00000100:00100000:0.0:1783969395.265841:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272146432 00000100:00100000:2.0:1783969395.265852:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272146560 00000100:00100000:2.0:1783969395.265856:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272146560 00000100:00100000:2.0:1783969395.265907:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:0.0:1783969395.265907:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 14 00000100:00100000:2.0:1783969395.265917:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:03985e57-ffb4-414b-b30c-e72697857d4f+7:9663:x1870627272146560:12345-192.168.203.39@tcp:700:mkdir.0 00000100:00100000:0.0:1783969395.265917:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+7:2350:x1870627272146432:12345-192.168.203.39@tcp:41:mkdir.0 00000004:00000024:0.0:1783969395.265955:0:6618:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783969395.265988:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:03985e57-ffb4-414b-b30c-e72697857d4f+7:9663:x1870627272146560:12345-192.168.203.39@tcp:700:mkdir.0 Request processed in 72us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969395.265993:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+7:2350:x1870627272146432:12345-192.168.203.39@tcp:41:mkdir.0 Request processed in 79us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969395.265995:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:0.0:1783969395.265998:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 14 00000100:00080000:0.0:1783969395.266014:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969395.270061:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969395.270286:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272146816 00000100:00100000:2.0:1783969395.270297:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272146816 00000100:00100000:2.0:1783969395.270358:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00100000:2.0:1783969395.270369:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+6:9663:x1870627272146816:12345-192.168.203.39@tcp:36:mkdir.0 00010000:00010000:2.0:1783969395.270431:0:10288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969395.270459:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faad1e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63031 expref: 6 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.270476:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac7829e0f00) 00010000:00010000:2.0:1783969395.270485:0:10288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783969395.270802:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3400/0xbacf56d076faae3d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.270816:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3400/0xbacf56d076faae3d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.270825:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3400/0xbacf56d076faae3d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.270901:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e2c00/0xbacf56d076faae44 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.270910:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e2c00/0xbacf56d076faae44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.270918:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e2c00/0xbacf56d076faae44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969395.272174:0:10288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1783969395.272190:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3400/0xbacf56d076faae3d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.272199:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3400/0xbacf56d076faae3d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.272206:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3400/0xbacf56d076faae3d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.272211:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c21e3400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969395.272215:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3400/0xbacf56d076faae3d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.272232:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3400/0xbacf56d076faae3d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.272246:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac785336f00) 00010000:00010000:2.0:1783969395.272249:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969395.272252:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3400/0xbacf56d076faae3d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.272268:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3400/0xbacf56d076faae3d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783969395.272285:0:10288:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007f72b81b reply state 00000000a30fb29f transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e2c00/0xbacf56d076faae44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969395.272294:0:10288:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783969395.272388:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+7:9663:x1870627272146816:12345-192.168.203.39@tcp:36:mkdir.0 Request processed in 2019us (2335us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783969395.272395:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 15 00010000:00010000:3.0:1783969395.278440:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e2c00/0xbacf56d076faae44 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.278456:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e2c00/0xbacf56d076faae44 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.278464:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e2c00/0xbacf56d076faae44 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.278470:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c21e2c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969395.278475:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e2c00/0xbacf56d076faae44 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.278482:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e2c00/0xbacf56d076faae44 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.278499:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ac785336900) 00010000:00010000:3.0:1783969395.278513:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969395.278517:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e2c00/0xbacf56d076faae44 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.278524:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e2c00/0xbacf56d076faae44 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969395.289680:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969395.289764:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272146944 00000100:00100000:0.0:1783969395.289774:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272146944 00000100:00100000:0.0:1783969395.289834:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:0.0:1783969395.289844:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+6:9664:x1870627272146944:12345-192.168.203.39@tcp:101:chmod.0 00010000:00010000:0.0:1783969395.289884:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969395.289909:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faae4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb630b6 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.289968:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076faae52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.289981:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076faae52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.289992:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076faae52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969395.290050:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1783969395.290055:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1783969395.290093:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076faae52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.290116:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faae4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630b6 expref: 8 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.290147:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076faae52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630b6 expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.290155:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac790086c00) 00010000:00010000:0.0:1783969395.290158:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783969395.290160:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93e00, rc 0) 00000100:00100000:0.0:1783969395.290212:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+7:9664:x1870627272146944:12345-192.168.203.39@tcp:101:chmod.0 Request processed in 369us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969395.290220:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:1.0:1783969395.305596:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969395.309525:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272147200 00000100:00100000:3.0:1783969395.309542:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272147200 00000100:00100000:3.0:1783969395.309652:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:3.0:1783969395.309664:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+7:9664:x1870627272147200:12345-192.168.203.39@tcp:36:chmod.0 00010000:00010000:3.0:1783969395.309721:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969395.309748:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076faae52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630b6 expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.309768:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac790086c00) 00010000:00010000:3.0:1783969395.309780:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783969395.309806:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faae59 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.309819:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faae59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.309828:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faae59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783969395.310140:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b617064b reply state 00000000711ec053 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faae59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969395.310149:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783969395.310171:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1783969395.310267:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+8:9664:x1870627272147200:12345-192.168.203.39@tcp:36:chmod.0 Request processed in 605us (4679us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1783969395.310275:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:2.0:1783969395.311529:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783969395.311547:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a787ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280569472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783969395.311600:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969395.311655:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280569472 00000100:00100000:2.0:1783969395.311661:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280569472 00000100:00100000:2.0:1783969395.311706:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783969395.311713:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280569472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969395.311741:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783969395.311780:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280569472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969395.311786:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1783969395.311806:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783969395.311847:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7a787ed80 x1870627280569472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969395.311883:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a787ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280569472:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783969395.316249:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faae59 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.316268:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faae59 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.316276:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faae59 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.316281:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969395.316285:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faae59 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.316294:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faae59 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.316310:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:3.0:1783969395.316313:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783969395.316318:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faae59 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.316324:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faae59 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969395.345241:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969395.345507:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272147328 00000100:00100000:1.0:1783969395.345517:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272147328 00000100:00100000:1.0:1783969395.345586:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:1.0:1783969395.345596:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+7:9665:x1870627272147328:12345-192.168.203.39@tcp:101:chown.0 00010000:00010000:1.0:1783969395.345618:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969395.345640:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076faae60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb630bd expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.345704:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fa00/0xbacf56d076faae67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.345717:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fa00/0xbacf56d076faae67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.345729:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fa00/0xbacf56d076faae67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969395.345787:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1783969395.345791:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1783969395.345986:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fa00/0xbacf56d076faae67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.346016:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076faae60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630bd expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.346103:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fa00/0xbacf56d076faae67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630bd expref: 8 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.346127:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac7829e0900) 00010000:00010000:1.0:1783969395.346130:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783969395.346134:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bf60fa00, rc 0) 00000100:00100000:1.0:1783969395.346199:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+8:9665:x1870627272147328:12345-192.168.203.39@tcp:101:chown.0 Request processed in 605us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969395.346206:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:2.0:1783969395.357427:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969395.357663:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272147456 00000100:00100000:3.0:1783969395.357673:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272147456 00000100:00100000:3.0:1783969395.357729:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:3.0:1783969395.357739:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+8:9665:x1870627272147456:12345-192.168.203.39@tcp:101:chown.0 00010000:00010000:3.0:1783969395.357763:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969395.357784:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faae6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb630c4 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.358301:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076faae75 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.358317:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076faae75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.358329:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076faae75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.358345:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076faae7c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.358352:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076faae7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.358359:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076faae7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.358454:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faae83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.358462:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faae83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.358469:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faae83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969395.358508:0:6618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1783969395.358519:0:6618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783969395.358625:0:6618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faae83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.358638:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076faae75 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.358644:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076faae75 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.358651:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076faae75 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.358656:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de7800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969395.358661:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076faae75 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.358668:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076faae75 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.358679:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac7829e0900) 00010000:00010000:3.0:1783969395.358682:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969395.358686:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076faae75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.358692:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076faae75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.358703:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076faae7c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.358709:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076faae7c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.358726:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076faae7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.358731:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de7a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969395.358734:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076faae7c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.358740:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076faae7c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.358747:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ac78c550200) 00010000:00010000:3.0:1783969395.358749:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969395.358752:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076faae7c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.358756:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076faae7c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.358787:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faae6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630c4 expref: 10 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.358801:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faae83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630c4 expref: 9 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.358807:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ac78c550900) 00010000:00010000:3.0:1783969395.358809:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783969395.358811:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de6000, rc 0) 00000100:00100000:3.0:1783969395.359260:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+9:9665:x1870627272147456:12345-192.168.203.39@tcp:101:chown.0 Request processed in 1521us (1840us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969395.359277:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:1.0:1783969395.362954:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969395.370535:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272147712 00000100:00100000:3.0:1783969395.370559:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272147712 00000100:00100000:3.0:1783969395.370622:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:3.0:1783969395.370632:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+9:9665:x1870627272147712:12345-192.168.203.39@tcp:36:chown.0 00010000:00010000:3.0:1783969395.370691:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969395.370718:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faae83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630c4 expref: 9 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.370738:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ac78c550900) 00010000:00010000:3.0:1783969395.370758:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783969395.370782:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faae8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.370795:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faae8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.370804:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faae8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783969395.418806:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:1.0:1783969395.418822:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1783969395.418902:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000054222b04 reply state 0000000058ecf9f9 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faae8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969395.418915:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783969395.419075:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:0.0:1783969395.419182:0:5794:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1783969395.419206:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+7:9665:x1870627272147712:12345-192.168.203.39@tcp:36:chown.0 Request processed in 48572us (56258us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1783969395.419216:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 20 00010000:00010000:1.0:1783969395.419306:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faae8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.419316:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faae8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.419324:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faae8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.419330:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969395.419335:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faae8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.419342:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faae8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.419358:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:1.0:1783969395.419361:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783969395.419365:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faae8a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.419383:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faae8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969395.451753:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969395.452333:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272147840 00000100:00100000:0.0:1783969395.452345:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272147840 00000100:00100000:0.0:1783969395.452419:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:0.0:1783969395.452430:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+6:9666:x1870627272147840:12345-192.168.203.39@tcp:101:touch.500 00010000:00010000:0.0:1783969395.452458:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969395.452481:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93600/0xbacf56d076faae91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb630cb expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783969395.457974:0:5793:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5404us 00010000:00010000:1.0:1783969395.469263:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076faae98 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.469286:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076faae98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.469300:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076faae98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.469314:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076faae9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.469321:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076faae9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.469328:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076faae9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.469794:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076faaea6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.469804:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076faaea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.469812:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076faaea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969395.469920:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783969395.469925:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783969395.470025:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076faaea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.470038:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076faae98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.470043:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076faae98 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.470049:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076faae98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.470055:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60e800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969395.470060:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076faae98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.470067:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076faae98 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.470079:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac7829e0900) 00010000:00010000:1.0:1783969395.470082:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969395.470086:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076faae98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.470093:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076faae98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.470103:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076faae9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.470110:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076faae9f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.470116:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076faae9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.470126:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60f200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969395.470129:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076faae9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.470136:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076faae9f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.470144:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ac7829e0500) 00010000:00010000:1.0:1783969395.470146:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969395.470149:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076faae9f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.470155:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076faae9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.470190:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93600/0xbacf56d076faae91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630cb expref: 8 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.470204:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076faaea6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630cb expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.470211:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ac7829e0100) 00010000:00010000:1.0:1783969395.470213:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783969395.470216:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bf60ec00, rc 0) 00000100:00100000:1.0:1783969395.470304:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+7:9666:x1870627272147840:12345-192.168.203.39@tcp:101:touch.500 Request processed in 17874us (18561us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969395.470312:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:0.0:1783969395.481562:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969395.481661:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272148096 00000100:00100000:3.0:1783969395.481672:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272148096 00000100:00100000:3.0:1783969395.481735:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:3.0:1783969395.481745:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+7:9666:x1870627272148096:12345-192.168.203.39@tcp:101:touch.500 00010000:00010000:3.0:1783969395.481768:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969395.481799:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faaead lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb630d2 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.482175:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076faaeb4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.482189:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076faaeb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.482203:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076faaeb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.482269:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076faaebb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.482278:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076faaebb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.482286:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076faaebb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783969395.483101:0:6618:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1783969395.483380:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faaec2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.483392:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faaec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.483402:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faaec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.483436:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076faaeb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.483452:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076faaeb4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.483458:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076faaeb4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.483464:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de7a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969395.483468:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076faaeb4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.483475:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076faaeb4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.483486:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ac7829e0100) 00010000:00010000:3.0:1783969395.483488:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969395.483492:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076faaeb4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.483498:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076faaeb4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783969395.483511:0:6618:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000551e7093 reply state 000000005ddc97b7 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076faaebb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969395.483519:0:6618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783969395.483553:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faaead lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630d2 expref: 10 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.483566:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faaec2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630d2 expref: 9 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.483585:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ac78c550500) 00010000:00010000:3.0:1783969395.483588:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783969395.483590:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de6800, rc 0) 00000100:00100000:3.0:1783969395.483663:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+10:9666:x1870627272148096:12345-192.168.203.39@tcp:101:touch.500 Request processed in 1918us (2110us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1783969395.483671:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 22 00010000:00010000:1.0:1783969395.487574:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076faaebb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.487606:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076faaebb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.487618:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076faaebb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.487625:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de7800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969395.487630:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076faaebb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.487638:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076faaebb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.487654:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff9ac78c550900) 00010000:00010000:1.0:1783969395.487657:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969395.487661:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076faaebb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.487666:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076faaebb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969395.491117:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969395.491419:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272148352 00000100:00100000:3.0:1783969395.491429:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272148352 00000100:00100000:3.0:1783969395.491490:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 23 00000100:00100000:3.0:1783969395.491501:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+9:9666:x1870627272148352:12345-192.168.203.39@tcp:36:touch.500 00010000:00010000:3.0:1783969395.491555:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969395.491581:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faaec2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630d2 expref: 9 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.491599:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ac78c550500) 00010000:00010000:3.0:1783969395.491611:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783969395.491651:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faaed0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.491663:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faaed0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969395.491671:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faaed0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783969395.491793:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aeb0f2e1 reply state 00000000fa094647 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faaed0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969395.491819:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783969395.492512:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+10:9666:x1870627272148352:12345-192.168.203.39@tcp:36:touch.500 Request processed in 1009us (1400us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1783969395.492521:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 23 00010000:00010000:1.0:1783969395.495455:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faaed0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.495473:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faaed0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.495481:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faaed0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.495487:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac781496200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969395.495506:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faaed0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.495515:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faaed0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.495542:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ac78c550f00) 00010000:00010000:1.0:1783969395.495546:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969395.495551:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faaed0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.495557:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faaed0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969395.497939:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969395.498201:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272148480 00000100:00100000:1.0:1783969395.498211:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272148480 00000100:00100000:1.0:1783969395.498278:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 24 00000100:00100000:1.0:1783969395.498288:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+9:9666:x1870627272148480:12345-192.168.203.39@tcp:101:touch.500 00010000:00010000:1.0:1783969395.498310:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969395.498333:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076faaed7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb630d9 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.498392:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076faaed7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630d9 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.498406:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076faaed7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630d9 expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.498424:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ac7829e0500) 00010000:00010000:1.0:1783969395.498427:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783969395.498444:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bf60f200, rc 0) 00000100:00100000:1.0:1783969395.498506:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+10:9666:x1870627272148480:12345-192.168.203.39@tcp:101:touch.500 Request processed in 219us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969395.498514:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 24 00000100:00100000:3.0:1783969395.502332:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969395.502433:0:9934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272148608 00000100:00100000:0.0:1783969395.502445:0:9934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272148608 00000100:00100000:0.0:1783969395.502493:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:0.0:1783969395.502501:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2347:x1870627272148608:12345-192.168.203.39@tcp:8:touch.500 00010000:00080000:0.0:1783969395.502540:0:9934:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 03985e57-ffb4-414b-b30c-e72697857d4f@192.168.203.39@tcp t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:0.0:1783969395.502572:0:9934:0:(genops.c:1406:class_connect()) connect: client 03985e57-ffb4-414b-b30c-e72697857d4f, cookie 0xbacf56d076faaede 00002000:00100000:0.0:1783969395.502585:0:9934:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 03985e57-ffb4-414b-b30c-e72697857d4f/ffff9ac7ba0dc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783969395.502596:0:9934:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:0.0:1783969395.502830:0:9934:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783969395.502904:0:9934:0:(import.c:65:import_set_state_nolock()) ffff9ac7ba0dd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783969395.502982:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681bf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+6:2347:x1870627272148608:12345-192.168.203.39@tcp:8:touch.500 Request processed in 480us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969395.502991:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:2.0:1783969395.506676:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969395.506759:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272148736 00000100:00100000:1.0:1783969395.506769:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272148736 00000100:00100000:1.0:1783969395.506844:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:1.0:1783969395.506853:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+6:0:x1870627272148736:12345-192.168.203.39@tcp:2:touch.500 00000100:00080000:2.0:1783969395.507709:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1783969395.604300:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 03985e57-ffb4-414b-b30c-e72697857d4f 00000001:00080000:1.0:1783969395.604320:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1783969395.604474:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+5:0:x1870627272148736:12345-192.168.203.39@tcp:2:touch.500 Request processed in 97615us (97801us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1783969395.604485:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:1.0:1783969395.609156:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969395.609289:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272148992 00000100:00100000:0.0:1783969395.609300:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272148992 00000100:00100000:0.0:1783969395.609364:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00100000:0.0:1783969395.609375:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+10:9666:x1870627272148992:12345-192.168.203.39@tcp:35:touch.500 00000100:00100000:0.0:1783969395.609699:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+11:9666:x1870627272148992:12345-192.168.203.39@tcp:35:touch.500 Request processed in 325us (553us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1783969395.609707:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00100000:3.0:1783969395.636418:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969395.636495:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272149120 00000100:00100000:0.0:1783969395.636506:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272149120 00000100:00100000:0.0:1783969395.636574:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 25 00000100:00100000:0.0:1783969395.636584:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+11:9667:x1870627272149120:12345-192.168.203.39@tcp:101:rm.0 00010000:00010000:0.0:1783969395.636607:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969395.636627:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92c00/0xbacf56d076faaee5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb630e0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.636690:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076faaeec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.636705:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076faaeec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.636717:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076faaeec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969395.636772:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783969395.636777:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783969395.636816:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076faaeec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.636840:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92c00/0xbacf56d076faaee5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630e0 expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.636905:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076faaeec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630e0 expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.636914:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ac7829e0100) 00010000:00010000:0.0:1783969395.636917:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783969395.636921:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92600, rc 0) 00000100:00100000:0.0:1783969395.636976:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+12:9667:x1870627272149120:12345-192.168.203.39@tcp:101:rm.0 Request processed in 393us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969395.636984:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 25 00000100:00100000:2.0:1783969395.652566:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969395.652700:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272149376 00000100:00100000:0.0:1783969395.652712:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272149376 00000100:00100000:0.0:1783969395.652773:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 26 00000100:00100000:0.0:1783969395.652782:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+12:9667:x1870627272149376:12345-192.168.203.39@tcp:101:rm.0 00010000:00010000:0.0:1783969395.652801:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969395.652830:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92c00/0xbacf56d076faaef3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb630e7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969395.652975:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1783969395.653093:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92c00/0xbacf56d076faaef3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630e7 expref: 14 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.653109:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac7829e0900) 00010000:00010000:0.0:1783969395.653113:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783969395.653118:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92c00/0xbacf56d076faaef3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630e7 expref: 14 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.653149:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92c00, rc 0) 00000100:00100000:0.0:1783969395.653210:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+13:9667:x1870627272149376:12345-192.168.203.39@tcp:101:rm.0 Request processed in 428us (653us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1783969395.653217:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 26 00000100:00100000:3.0:1783969395.663435:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969395.663546:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272149504 00000100:00100000:0.0:1783969395.663556:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272149504 00000100:00100000:0.0:1783969395.663615:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3 00000100:00100000:0.0:1783969395.663625:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+13:9667:x1870627272149504:12345-192.168.203.39@tcp:37:rm.0 00000100:00100000:0.0:1783969395.671665:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+13:9667:x1870627272149504:12345-192.168.203.39@tcp:37:rm.0 Request processed in 8030us (8228us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969395.671680:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3 00000100:00100000:2.0:1783969395.680988:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969395.681098:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272149760 00000100:00100000:1.0:1783969395.681108:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272149760 00000100:00100000:1.0:1783969395.681173:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:1.0:1783969395.681183:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786072450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+13:9667:x1870627272149760:12345-192.168.203.39@tcp:35:rm.0 00000100:00100000:1.0:1783969395.681461:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786072450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+14:9667:x1870627272149760:12345-192.168.203.39@tcp:35:rm.0 Request processed in 278us (481us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1783969395.681469:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:3.0:1783969395.695525:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969395.695679:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272150016 00000100:00100000:0.0:1783969395.695690:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272150016 00000100:00100000:0.0:1783969395.695752:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 27 00000100:00100000:0.0:1783969395.695762:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+14:9667:x1870627272150016:12345-192.168.203.39@tcp:101:rm.0 00010000:00010000:0.0:1783969395.695788:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969395.695817:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92c00/0xbacf56d076faaf01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb630ee expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.695986:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076faaf08 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.696001:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076faaf08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.696013:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076faaf08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969395.696045:0:6618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1783969395.696202:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92c00/0xbacf56d076faaf01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630ee expref: 17 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.696232:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076faaf08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630ee expref: 16 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.696242:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ac7829e0100) 00010000:00010000:0.0:1783969395.696245:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783969395.696249:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92e00, rc 0) 00000100:00100000:0.0:1783969395.696304:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+16:9667:x1870627272150016:12345-192.168.203.39@tcp:101:rm.0 Request processed in 543us (787us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1783969395.696311:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 27 00000100:00100000:1.0:1783969395.712240:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969395.721513:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272150144 00000100:00100000:2.0:1783969395.721567:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272150144 00000100:00100000:2.0:1783969395.721642:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 28 00000100:00100000:2.0:1783969395.721672:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+16:9667:x1870627272150144:12345-192.168.203.39@tcp:41:rm.0 00000004:00000024:2.0:1783969395.721780:0:10288:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1783969395.722320:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+16:9667:x1870627272150144:12345-192.168.203.39@tcp:41:rm.0 Request processed in 666us (10097us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969395.722328:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 28 00000100:00100000:2.0:1783969395.724753:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969395.728147:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272150272 00000100:00100000:1.0:1783969395.728162:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272150272 00000100:00100000:0.0:1783969395.736172:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 29 00000100:00100000:0.0:1783969395.736186:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+16:9667:x1870627272150272:12345-192.168.203.39@tcp:101:rm.0 00010000:00010000:0.0:1783969395.736207:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969395.736238:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92c00/0xbacf56d076faaf16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb630f5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736299:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92200/0xbacf56d076faaf1d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736313:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92200/0xbacf56d076faaf1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736324:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92200/0xbacf56d076faaf1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736357:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93600/0xbacf56d076faaf24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736364:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93600/0xbacf56d076faaf24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736371:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93600/0xbacf56d076faaf24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736475:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faaf2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736484:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faaf2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736491:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faaf2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969395.736516:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1783969395.736520:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783969395.736537:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faaf2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736548:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faaf2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736556:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92200/0xbacf56d076faaf1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736562:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92200/0xbacf56d076faaf1d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736577:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92200/0xbacf56d076faaf1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736596:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969395.736600:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92200/0xbacf56d076faaf1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736608:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92200/0xbacf56d076faaf1d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736620:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ac7829e0100) 00010000:00010000:0.0:1783969395.736623:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969395.736628:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92200/0xbacf56d076faaf1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736635:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92200/0xbacf56d076faaf1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736648:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93600/0xbacf56d076faaf24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736654:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93600/0xbacf56d076faaf24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736659:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93600/0xbacf56d076faaf24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736664:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969395.736667:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93600/0xbacf56d076faaf24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736682:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93600/0xbacf56d076faaf24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736690:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff9ac790086900) 00010000:00010000:0.0:1783969395.736692:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969395.736695:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93600/0xbacf56d076faaf24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736700:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93600/0xbacf56d076faaf24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736729:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92c00/0xbacf56d076faaf16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630f5 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736742:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faaf2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630f5 expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.736750:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ac7829e0500) 00010000:00010000:0.0:1783969395.736752:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969395.736754:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93800, rc 0) 00000100:00100000:0.0:1783969395.737293:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+17:9667:x1870627272150272:12345-192.168.203.39@tcp:101:rm.0 Request processed in 1107us (12545us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969395.737302:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 29 00000100:00100000:3.0:1783969395.746490:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969395.746839:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272150528 00000100:00100000:1.0:1783969395.746849:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272150528 00000100:00100000:2.0:1783969395.747251:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 30 00000100:00100000:2.0:1783969395.747264:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+17:9667:x1870627272150528:12345-192.168.203.39@tcp:36:rm.0 00010000:00010000:2.0:1783969395.747320:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783969395.747346:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faaf2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630f5 expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.747367:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076faaed7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630d9 expref: 16 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.747378:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ac7829e0500) 00010000:00010000:2.0:1783969395.747406:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076faaeec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630e0 expref: 15 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.747434:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ac7829e0100) 00010000:00010000:2.0:1783969395.747438:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783969395.747461:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e2c00/0xbacf56d076faaf32 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.747473:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e2c00/0xbacf56d076faaf32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.747481:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e2c00/0xbacf56d076faaf32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.747494:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3400/0xbacf56d076faaf39 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.747501:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3400/0xbacf56d076faaf39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.747508:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3400/0xbacf56d076faaf39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.748108:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3c00/0xbacf56d076faaf40 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.748119:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3c00/0xbacf56d076faaf40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.748201:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3c00/0xbacf56d076faaf40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783969395.749412:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1783969395.749424:0:5795:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 252831563679ns, next at 253831561305ns, rc = 0 00010000:00010000:2.0:1783969395.749488:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3e00/0xbacf56d076faaf47 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.749501:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3e00/0xbacf56d076faaf47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.749509:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3e00/0xbacf56d076faaf47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.749516:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3e00/0xbacf56d076faaf47 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.749522:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3e00/0xbacf56d076faaf47 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.749529:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3e00/0xbacf56d076faaf47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.749558:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783969395.749577:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3c00/0xbacf56d076faaf40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.749583:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3c00/0xbacf56d076faaf40 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.749589:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3c00/0xbacf56d076faaf40 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.749595:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c21e3c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969395.749599:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3c00/0xbacf56d076faaf40 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.749606:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3c00/0xbacf56d076faaf40 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.749625:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ac785336f00) 00010000:00010000:2.0:1783969395.749628:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783969395.749632:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3c00/0xbacf56d076faaf40 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.749639:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3c00/0xbacf56d076faaf40 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.749667:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e2c00/0xbacf56d076faaf32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.749674:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e2c00/0xbacf56d076faaf32 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.749680:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e2c00/0xbacf56d076faaf32 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.749686:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c21e2c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969395.749688:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e2c00/0xbacf56d076faaf32 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.749695:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e2c00/0xbacf56d076faaf32 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.749702:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ac7829e0100) 00010000:00010000:2.0:1783969395.749705:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969395.749707:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e2c00/0xbacf56d076faaf32 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.749713:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e2c00/0xbacf56d076faaf32 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783969395.749736:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000023e8b2a4 reply state 000000001e9968fa transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3400/0xbacf56d076faaf39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969395.749756:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783969395.749989:0:8303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969395.749995:0:8303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3e00/0xbacf56d076faaf47 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.750001:0:8303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c21e3e00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969395.750010:0:8303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3e00/0xbacf56d076faaf47 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.750016:0:8303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3e00/0xbacf56d076faaf47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.750026:0:8303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9ac785336f00) 00010000:00010000:0.0:1783969395.750028:0:8303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783969395.750031:0:8303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3e00/0xbacf56d076faaf47 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.750036:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3e00/0xbacf56d076faaf47 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969395.750051:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969395.750053:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969395.750055:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969395.750377:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+16:9667:x1870627272150528:12345-192.168.203.39@tcp:36:rm.0 Request processed in 3112us (3891us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1783969395.750387:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 30 00010000:00010000:1.0:1783969395.753893:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3400/0xbacf56d076faaf39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.753912:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3400/0xbacf56d076faaf39 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.753939:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3400/0xbacf56d076faaf39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.753945:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c21e3400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969395.753949:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3400/0xbacf56d076faaf39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.753958:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3400/0xbacf56d076faaf39 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.753973:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff9ac785336600) 00010000:00010000:1.0:1783969395.753975:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969395.753980:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3400/0xbacf56d076faaf39 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.753986:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c21e3400/0xbacf56d076faaf39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969395.756047:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969395.756274:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272150784 00000100:00100000:1.0:1783969395.756284:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272150784 00000100:00100000:1.0:1783969395.756348:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:1.0:1783969395.756359:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+15:9667:x1870627272150784:12345-192.168.203.39@tcp:35:rm.0 00000100:00100000:1.0:1783969395.756623:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+16:9667:x1870627272150784:12345-192.168.203.39@tcp:35:rm.0 Request processed in 265us (584us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1783969395.756631:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:2.0:1783969395.765972:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969395.771195:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272151040 00000100:00100000:1.0:1783969395.771230:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272151040 00000100:00100000:1.0:1783969395.771334:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 31 00000100:00100000:1.0:1783969395.771345:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+16:9667:x1870627272151040:12345-192.168.203.39@tcp:36:rm.0 00010000:00010000:1.0:1783969395.771416:0:10288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783969395.771442:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076faaf08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630ee expref: 16 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.771464:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076faaea6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630cb expref: 15 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.771475:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ac7829e0100) 00010000:00010000:1.0:1783969395.771490:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fa00/0xbacf56d076faae67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630bd expref: 14 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.771498:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac7829e0900) 00010000:00010000:1.0:1783969395.771504:0:10288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783969395.771741:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076faaf4e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.771755:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076faaf4e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.771766:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076faaf4e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.771779:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076faaf55 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.771786:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076faaf55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.771792:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076faaf55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.772321:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076faaf5c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.772332:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076faaf5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.772339:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076faaf5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969395.773419:0:10288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1783969395.773439:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076faaf5c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.773447:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076faaf5c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.773454:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076faaf5c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.773460:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60e400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969395.773464:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076faaf5c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.773471:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076faaf5c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.773483:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ac7829e0800) 00010000:00010000:2.0:1783969395.773486:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783969395.773490:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076faaf5c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.773508:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076faaf5c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.773530:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076faaf4e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.773537:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076faaf4e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.773556:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076faaf4e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.773561:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60f800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969395.773565:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076faaf4e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.773572:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076faaf4e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.773581:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac7829e0600) 00010000:00010000:2.0:1783969395.773583:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969395.773594:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076faaf4e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969395.773601:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076faaf4e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783969395.773615:0:10288:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000054655d4f reply state 00000000b5dc2105 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076faaf55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969395.773624:0:10288:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783969395.773720:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+15:9667:x1870627272151040:12345-192.168.203.39@tcp:36:rm.0 Request processed in 2374us (7753us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1783969395.773729:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 31 00010000:00010000:1.0:1783969395.778404:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076faaf55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.778420:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076faaf55 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.778428:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076faaf55 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.778434:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60fc00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969395.778438:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076faaf55 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.778445:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076faaf55 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.778462:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9ac7829e0200) 00010000:00010000:1.0:1783969395.778465:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969395.778470:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076faaf55 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969395.778475:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076faaf55 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969395.813299:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a787d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870627280569728:0@lo:400:kworker.0 00000100:00100000:1.0:1783969395.813367:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969395.813439:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783969395.813445:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a787c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280569600:0@lo:400:kworker.0 00000100:00100000:1.0:1783969395.813474:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969395.813495:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280570112:0@lo:400:kworker.0 00000100:00100000:1.0:1783969395.813518:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969395.813559:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1870627280569984:0@lo:400:kworker.0 00000100:00100000:1.0:1783969395.813582:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969395.813601:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783969395.813606:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1870627280569856:0@lo:400:kworker.0 00000100:00100000:1.0:1783969395.813627:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969395.813654:0:9934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280570112 00000100:00100000:1.0:1783969395.813660:0:9934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280570112 00000100:00100000:1.0:1783969395.813709:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783969395.813718:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280570112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969395.813767:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280570112:12345-0@lo:400:kworker.0 Request processed in 49us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969395.813783:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1783969395.813802:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783969395.813828:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7a7a81180 x1870627280570112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969395.813841:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280570112:0@lo:400:kworker.0 00000100:00100000:1.0:1783969395.813887:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280569728 00000100:00100000:1.0:1783969395.813903:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280569728 00000100:00100000:1.0:1783969395.813928:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280569984 00000100:00100000:1.0:1783969395.813931:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280569984 00000100:00100000:1.0:1783969395.813952:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280569856 00000100:00100000:1.0:1783969395.813955:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280569856 00000100:00100000:1.0:1783969395.813969:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783969395.813975:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870627280569728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969395.814012:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870627280569728:12345-0@lo:400:kworker.0 Request processed in 37us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969395.814018:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783969395.814029:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783969395.814034:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1870627280569984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969395.814063:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1870627280569984:12345-0@lo:400:kworker.0 Request processed in 29us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969395.814068:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783969395.814079:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783969395.814084:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1870627280569856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969395.814110:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1870627280569856:12345-0@lo:400:kworker.0 Request processed in 26us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969395.814116:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1783969395.814129:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969395.814146:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1870627280569856:0@lo:400:kworker.0 00000100:00100000:1.0:1783969395.814155:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1870627280569984:0@lo:400:kworker.0 00000100:00100000:1.0:1783969395.814177:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a787d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870627280569728:0@lo:400:kworker.0 00000100:00100000:3.0:1783969395.814558:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280569600 00000100:00100000:3.0:1783969395.814564:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280569600 00000100:00100000:3.0:1783969395.814603:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1783969395.814610:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:3288:x1870627280569600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969395.814656:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:3288:x1870627280569600:12345-0@lo:400:kworker.0 Request processed in 47us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969395.814663:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1783969395.815151:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a787c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280569600:0@lo:400:kworker.0 00010000:00010000:3.0:1783969396.260984:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969396.325135:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783969396.325169:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280570240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969396.325247:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969396.325441:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280570240 00000100:00100000:1.0:1783969396.325450:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280570240 00000100:00100000:1.0:1783969396.325509:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783969396.325519:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280570240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783969396.325575:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783969396.325636:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280570240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969396.325644:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1783969396.326910:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7bf6d4000 x1870627280570240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969396.326932:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280570240:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783969397.285084:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969397.303060:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969397.303094:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969397.303180:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969397.303230:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969397.303682:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272151168 00000100:00100000:3.0:1783969397.303692:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272151168 00000100:00100000:3.0:1783969397.303756:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 244 00000100:00100000:3.0:1783969397.303766:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2349:x1870627272151168:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969397.303808:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272151296 00000100:00100000:0.0:1783969397.303815:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272151296 00000100:00100000:3.0:1783969397.303840:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2349:x1870627272151168:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 75us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969397.303849:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 244 00000100:00100000:0.0:1783969397.303887:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272151552 00000100:00100000:0.0:1783969397.304332:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272151552 00000100:00100000:0.0:1783969397.304372:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 92 00000100:00100000:0.0:1783969397.304381:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+14:2349:x1870627272151296:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969397.304504:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+14:2349:x1870627272151296:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 123us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969397.304524:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 92 00000100:00100000:0.0:1783969397.304538:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 93 00000100:00100000:0.0:1783969397.304545:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2349:x1870627272151552:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969397.304575:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2349:x1870627272151552:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 31us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969397.304581:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 93 00000100:00080000:0.0:1783969397.305079:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969397.309782:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272151424 00000100:00100000:1.0:1783969397.309796:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272151424 00000100:00100000:1.0:1783969397.309897:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 44 00000100:00100000:1.0:1783969397.309914:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+5:2349:x1870627272151424:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969397.309989:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+5:2349:x1870627272151424:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 83us (6894us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969397.309997:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 44 00000100:00080000:0.0:1783969397.310517:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783969398.309100:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969399.333012:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783969399.641689:0:11468:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1783969400.358025:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783969400.424483:0:6644:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 257506621416ns, next at 258506618780ns, rc = 0 00000100:00100000:3.0:1783969400.425762:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac787782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280570368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969400.425971:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969400.426251:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280570368 00000100:00100000:0.0:1783969400.426259:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280570368 00000100:00100000:0.0:1783969400.426326:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783969400.426336:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280570368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783969400.426369:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783969400.426412:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681bf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280570368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969400.426492:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1783969400.426594:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783969400.426649:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac787782a00 x1870627280570368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969400.426668:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac787782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280570368:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1783969400.476445:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967305 is committed 00000001:00080000:0.0:1783969400.476468:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1783969400.476479:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1783969400.476659:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969400.476679:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681bf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280570496:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783969400.476744:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969400.476807:0:9934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280570496 00000100:00100000:3.0:1783969400.476814:0:9934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280570496 00000100:00100000:3.0:1783969400.476883:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783969400.476891:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681bf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280570496:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1783969400.476916:0:9934:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1783969400.476953:0:9934:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a553673, atime: 0x6a553673, ctime: 0x6a553673, blocks: 0x1 00010000:00010000:3.0:1783969400.476961:0:9934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000965acd2f/0xbacf56d076faaf63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969400.476977:0:9934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=257s v=(0 0) 00010000:00010000:3.0:1783969400.476981:0:9934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969400.476999:0:9934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000965acd2f/0xbacf56d076faaf63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969400.477015:0:9934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000965acd2f/0xbacf56d076faaf63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969400.477025:0:9934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000965acd2f/0xbacf56d076faaf63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969400.477032:0:9934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000965acd2f/0xbacf56d076faaf63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969400.477060:0:9934:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783969400.477602:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681bf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3285:x1870627280570496:12345-0@lo:6:osp-syn-0-0.0 Request processed in 711us (857us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1783969400.477610:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:3.0:1783969400.477659:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ac681bf2300/2, rc 0, transno 4294967300 00000100:00100000:3.0:1783969400.477665:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681bf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280570496:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783969400.480146:0:8303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969400.480158:0:8303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000965acd2f/0xbacf56d076faaf63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969400.480172:0:8303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac781497600 already unused, calling callback (ffffffffc1485230) 00010000:00010000:2.0:1783969400.480177:0:8303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000965acd2f/0xbacf56d076faaf63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969400.480188:0:8303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000965acd2f/0xbacf56d076faaf63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969400.480222:0:8303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000965acd2f/0xbacf56d076faaf63 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969400.480229:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000965acd2f/0xbacf56d076faaf63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969400.480249:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969400.480251:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969400.480259:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783969400.629641:0:11517:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd26c94b90 20000000:00000080:2.0:1783969400.629657:0:11517:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ac7883c0c00 uarg=0000000000000000 20000000:01000000:2.0:1783969400.629690:0:11517:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1783969400.629696:0:11517:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1783969400.629700:0:11517:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1783969400.630478:0:11518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1783969400.630636:0:11517:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1783969400.637121:0:11517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1783969400.637183:0:11517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1783969400.637253:0:11517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1783969400.637271:0:11517:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783969400.637289:0:11517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac7c21e3e00/0xbacf56d076faaf6a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969400.637306:0:11517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac783de6a00/0xbacf56d076faae0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faae05 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969400.637313:0:11517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac783de7e00/0xbacf56d076faae1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faae13 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969400.637320:0:11517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac7bfb93000/0xbacf56d076faae28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faae21 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969400.637328:0:11517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac783de7400/0xbacf56d076faae2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630a8 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969400.637335:0:11517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac783de7600/0xbacf56d076faae36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630af expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969400.637341:0:11517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ac7c21e3e00/0xbacf56d076faaf6a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969400.637395:0:11517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac783de7600/0xbacf56d076faae36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630af expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969400.637409:0:11517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac783de7600/0xbacf56d076faae36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630af expref: 12 pid: 5787 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969400.637424:0:11517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798166680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1870627280570624:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969400.637519:0:11517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac783de7400/0xbacf56d076faae2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630a8 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969400.637528:0:11517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac783de7400/0xbacf56d076faae2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630a8 expref: 12 pid: 5787 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969400.637536:0:11517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798167100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1870627280570752:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969400.637566:0:11517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac7bfb93000/0xbacf56d076faae28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faae21 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969400.637574:0:11517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac7bfb93000/0xbacf56d076faae28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faae21 expref: 18 pid: 5788 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969400.637583:0:11517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798165500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1870627280570880:0@lo:104: 00000100:00100000:2.0:1783969400.637621:0:11517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783969400.637659:0:11517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac783de7e00/0xbacf56d076faae1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faae13 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969400.637667:0:11517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac783de7e00/0xbacf56d076faae1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faae13 expref: 18 pid: 5787 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969400.637686:0:11517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac798167800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1870627280571008:0@lo:104: 00000100:00100000:2.0:1783969400.637709:0:11517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783969400.637738:0:11517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac783de6a00/0xbacf56d076faae0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076faae05 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969400.637746:0:11517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ac783de6a00/0xbacf56d076faae0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076faae05 expref: 18 pid: 5788 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969400.637754:0:11517:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1870627280571136:0@lo:104: 00000100:00100000:2.0:1783969400.637774:0:11517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969400.637787:0:11517:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bf74cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1783969400.637830:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783969400.637853:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280570880 00000100:00100000:2.0:1783969400.637997:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280570880 00000100:00100000:2.0:1783969400.638033:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280571008 00000100:00100000:2.0:1783969400.638036:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280571008 00000100:00100000:2.0:1783969400.638046:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280571136 00000100:00100000:2.0:1783969400.638049:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280571136 00000100:00100000:2.0:1783969400.638062:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783969400.638070:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798164700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+5:11517:x1870627280570880:12345-0@lo:104: 00010000:00010000:2.0:1783969400.638081:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac781496c00/0xbacf56d076faae21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faae28 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969400.638134:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783969400.638140:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798164700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+5:11517:x1870627280570880:12345-0@lo:104: Request processed in 71us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969400.638146:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783969400.638164:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783969400.638177:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+4:11517:x1870627280571008:12345-0@lo:104: 00010000:00010000:2.0:1783969400.638184:0:5776:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb92400/0xbacf56d076faae13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faae1a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969400.638341:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783969400.638351:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf5aa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c893ad09-f78f-4711-bea5-6489668294ed+4:11517:x1870627280571136:12345-0@lo:104: 00010000:00010000:0.0:1783969400.638360:0:8302:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faae05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faae0c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969400.638411:0:8302:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783969400.638417:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf5aa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c893ad09-f78f-4711-bea5-6489668294ed+4:11517:x1870627280571136:12345-0@lo:104: Request processed in 69us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969400.638423:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1783969400.638445:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783969400.638451:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac781496c00/0xbacf56d076faae21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faae28 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969400.638459:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac781496c00 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:0.0:1783969400.638463:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac781496c00/0xbacf56d076faae21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faae28 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969400.638472:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac781496c00/0xbacf56d076faae21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faae28 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969400.638479:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac781496c00/0xbacf56d076faae21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faae28 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969400.638485:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783969400.638514:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac781496c00/0xbacf56d076faae21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faae28 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969400.638521:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969400.638540:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac781496c00/0xbacf56d076faae21 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faae28 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969400.638547:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac781496c00/0xbacf56d076faae21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faae28 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969400.638569:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969400.638573:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faae05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faae0c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969400.638578:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac781496000 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:0.0:1783969400.638581:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faae05 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faae0c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969400.638589:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faae05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faae0c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969400.638595:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faae05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faae0c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969400.638600:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783969400.638615:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faae05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faae0c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969400.638621:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969400.638627:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faae05 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faae0c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969400.638634:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faae05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faae0c expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969400.638642:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969400.638644:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969400.638646:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969400.638664:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac787782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280571264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783969400.638700:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969400.638730:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783969400.638735:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac787780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280571392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783969400.638763:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969400.638792:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280571264 00000100:00100000:0.0:1783969400.638796:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280571264 00010000:00010000:0.0:1783969400.638815:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac7bfb93000/0xbacf56d076faae28 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faae21 expref: 19 pid: 5788 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969400.638832:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280571392 00000100:00100000:0.0:1783969400.638835:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280571392 00010000:00010000:0.0:1783969400.638845:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac783de6a00/0xbacf56d076faae0c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faae05 expref: 20 pid: 5788 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969400.638883:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783969400.638889:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787782680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c893ad09-f78f-4711-bea5-6489668294ed+20:3287:x1870627280571264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783969400.638899:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969400.638904:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac7bfb93000/0xbacf56d076faae28 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faae21 expref: 20 pid: 5788 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969400.638912:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac7bfb93000/0xbacf56d076faae28 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faae21 expref: 20 pid: 5788 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969400.638927:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969400.638951:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787782680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c893ad09-f78f-4711-bea5-6489668294ed+20:3287:x1870627280571264:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969400.638957:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783969400.638969:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783969400.638974:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c893ad09-f78f-4711-bea5-6489668294ed+19:3287:x1870627280571392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783969400.638987:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969400.638991:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac783de6a00/0xbacf56d076faae0c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faae05 expref: 19 pid: 5788 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969400.638999:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac783de6a00/0xbacf56d076faae0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faae05 expref: 19 pid: 5788 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969400.639009:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969400.639029:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c893ad09-f78f-4711-bea5-6489668294ed+19:3287:x1870627280571392:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969400.639035:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783969400.639076:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac787780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280571392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783969400.639085:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac787782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280571264:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783969400.640093:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969400.640143:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7bfb93000/0xbacf56d076faae28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faae21 expref: 18 pid: 5788 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969400.640159:0:11517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798165500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1870627280570880:0@lo:104: 00010000:00010000:0.0:1783969400.640170:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac783de6a00/0xbacf56d076faae0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faae05 expref: 17 pid: 5788 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969400.640178:0:11517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1870627280571136:0@lo:104: 00010000:00010000:2.0:1783969400.641218:0:5776:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783969400.641227:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c893ad09-f78f-4711-bea5-6489668294ed+3:11517:x1870627280571008:12345-0@lo:104: Request processed in 3049us (3515us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969400.641235:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1783969400.641322:0:8303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969400.641329:0:8303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb92400/0xbacf56d076faae13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076faae1a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969400.641338:0:8303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92400 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:1.0:1783969400.641342:0:8303:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb92400/0xbacf56d076faae13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076faae1a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969400.641351:0:8303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb92400/0xbacf56d076faae13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076faae1a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783969400.641371:0:8303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb92400/0xbacf56d076faae13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076faae1a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969400.641377:0:8303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783969400.641416:0:8303:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb92400/0xbacf56d076faae13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faae1a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969400.641423:0:8303:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783969400.641443:0:8303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb92400/0xbacf56d076faae13 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faae1a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969400.641450:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb92400/0xbacf56d076faae13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076faae1a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969400.641464:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969400.641466:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969400.641468:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969400.641481:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280571520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783969400.641530:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969400.641579:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280571520 00000100:00100000:1.0:1783969400.641585:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280571520 00010000:00010000:1.0:1783969400.641610:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac783de7e00/0xbacf56d076faae1a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faae13 expref: 17 pid: 5787 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969400.641635:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783969400.641643:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a60850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c893ad09-f78f-4711-bea5-6489668294ed+17:3285:x1870627280571520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783969400.641653:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969400.641658:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac783de7e00/0xbacf56d076faae1a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076faae13 expref: 17 pid: 5787 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969400.641673:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac783de7e00/0xbacf56d076faae1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076faae13 expref: 17 pid: 5787 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969400.641689:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969400.641724:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a60850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c893ad09-f78f-4711-bea5-6489668294ed+17:3285:x1870627280571520:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969400.641730:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783969400.641787:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280571520:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783969400.642242:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac783de7e00/0xbacf56d076faae1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076faae13 expref: 16 pid: 5787 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969400.642254:0:11517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798167800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1870627280571008:0@lo:104: 00000100:00100000:0.0:1783969400.645958:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969400.646024:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969400.646142:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272151680 00000100:00100000:3.0:1783969400.646150:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272151680 00010000:00010000:3.0:1783969400.646185:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac783de7600/0xbacf56d076faae36 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630af expref: 13 pid: 5787 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969400.646234:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272151808 00000100:00100000:3.0:1783969400.646237:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272151808 00010000:00010000:3.0:1783969400.646250:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac783de7400/0xbacf56d076faae2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630a8 expref: 14 pid: 5787 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969400.646269:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 33 00000100:00100000:3.0:1783969400.646278:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+14:2351:x1870627272151680:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969400.646291:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969400.646297:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac783de7600/0xbacf56d076faae36 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630af expref: 14 pid: 5787 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969400.646310:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac783de7600/0xbacf56d076faae36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630af expref: 14 pid: 5787 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969400.646329:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969400.646377:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+14:2351:x1870627272151680:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 99us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969400.646391:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 33 00000100:00100000:3.0:1783969400.646408:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 34 00000100:00100000:3.0:1783969400.646415:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2351:x1870627272151808:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969400.646422:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969400.646427:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac783de7400/0xbacf56d076faae2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630a8 expref: 13 pid: 5787 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969400.646436:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac783de7400/0xbacf56d076faae2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630a8 expref: 13 pid: 5787 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969400.646449:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ac7c21e3e00/0xbacf56d076faaf6a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969400.646458:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7c21e3e00/0xbacf56d076faaf6a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969400.646473:0:5780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac7c21e3e00/0xbacf56d076faaf6a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969400.646480:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac7c21e3e00/0xbacf56d076faaf6a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969400.646487:0:5780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac7c21e3e00/0xbacf56d076faaf6a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969400.646493:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac7c21e3e00/0xbacf56d076faaf6a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969400.646566:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c21e3e00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:3.0:1783969400.646577:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac7c21e3e00/0xbacf56d076faaf6a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969400.646586:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac7c21e3e00/0xbacf56d076faaf6a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969400.646596:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac7c21e3e00/0xbacf56d076faaf6a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969400.646606:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969400.646628:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2351:x1870627272151808:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 213us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969400.646634:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 34 00010000:00010000:2.0:1783969400.646820:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac783de7600/0xbacf56d076faae36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630af expref: 12 pid: 5787 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969400.646834:0:11517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798166680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1870627280570624:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969400.646847:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac783de7400/0xbacf56d076faae2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630a8 expref: 11 pid: 5787 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969400.646855:0:11517:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac798167100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11517:1870627280570752:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969400.646906:0:11517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ac7c21e3e00/0xbacf56d076faaf6a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969400.646916:0:11517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ac7c21e3e00/0xbacf56d076faaf6a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969400.646923:0:11517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac7c21e3e00/0xbacf56d076faaf6a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969400.646929:0:11517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7c21e3e00/0xbacf56d076faaf6a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969400.933437:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a76c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280571776:0@lo:400:kworker.0 00000100:00100000:0.0:1783969400.933528:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969400.933587:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a76c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280572288:0@lo:400:kworker.0 00000100:00100000:0.0:1783969400.933613:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969400.933642:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783969400.933649:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a76c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280571904:0@lo:400:kworker.0 00000100:00100000:0.0:1783969400.933671:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969400.933707:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280571776 00000100:00100000:0.0:1783969400.933713:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280571776 00000100:00100000:0.0:1783969400.933753:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280571904 00000100:00100000:0.0:1783969400.933756:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280571904 00000100:00100000:0.0:1783969400.933783:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783969400.933792:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280571776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969400.933839:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280571776:12345-0@lo:400:kworker.0 Request processed in 49us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969400.933846:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783969400.933882:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783969400.933890:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280571904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969400.933919:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280571904:12345-0@lo:400:kworker.0 Request processed in 31us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969400.933925:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1783969400.933946:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969400.933973:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a76c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280571904:0@lo:400:kworker.0 00000100:00100000:0.0:1783969400.933982:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a76c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280571776:0@lo:400:kworker.0 00000100:00100000:3.0:1783969400.934176:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a76c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280572032:0@lo:400:kworker.0 00000100:00100000:3.0:1783969400.934219:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969400.934253:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783969400.934259:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a76c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280571648:0@lo:400:kworker.0 00000100:00100000:3.0:1783969400.934286:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969400.934307:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a76c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1870627280572160:0@lo:400:kworker.0 00000100:00100000:3.0:1783969400.934327:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969400.934352:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280572160 00000100:00100000:3.0:1783969400.934356:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280572160 00000100:00100000:3.0:1783969400.934384:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783969400.934391:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1870627280572160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969400.934425:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1870627280572160:12345-0@lo:400:kworker.0 Request processed in 34us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969400.934431:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783969400.934455:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a76c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1870627280572160:0@lo:400:kworker.0 00000100:00100000:0.0:1783969400.934666:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280572288 00000100:00100000:0.0:1783969400.934677:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280572288 00000100:00100000:0.0:1783969400.934747:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280572032 00000100:00100000:0.0:1783969400.934750:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280572032 00000100:00100000:2.0:1783969400.934908:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280571648 00000100:00100000:2.0:1783969400.934920:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280571648 00000100:00100000:2.0:1783969400.934950:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1783969400.934956:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+16:3285:x1870627280571648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969400.934995:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+16:3285:x1870627280571648:12345-0@lo:400:kworker.0 Request processed in 39us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969400.935001:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1783969400.935036:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a76c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280571648:0@lo:400:kworker.0 00000100:00080000:2.0:1783969400.938307:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783969400.938320:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969400.938703:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783969400.938726:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280572288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969400.938898:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280572288:12345-0@lo:400:kworker.0 Request processed in 185us (5283us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969400.938906:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783969400.938929:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783969400.938937:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3285:x1870627280572032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969400.938977:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3285:x1870627280572032:12345-0@lo:400:kworker.0 Request processed in 41us (4757us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969400.938983:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783969400.939034:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a76c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280572032:0@lo:400:kworker.0 00010000:00080000:2.0:1783969400.944912:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7a76c0a80 x1870627280572288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969400.944930:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a76c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280572288:0@lo:400:kworker.0 00000001:00080000:1.0:1783969401.019305:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1783969401.381529:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969401.445168:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280572416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969401.445248:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969401.445399:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280572416 00000100:00100000:1.0:1783969401.445407:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280572416 00000100:00100000:1.0:1783969401.445456:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783969401.445465:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280572416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783969401.445513:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783969401.445565:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280572416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969401.445573:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1783969401.445905:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7bf6d5500 x1870627280572416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969401.445924:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280572416:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1783969401.701033:0:5790:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783969401.701041:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ac7bf7a8800 from 7 10000000:01000000:2.0:1783969401.701046:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783969401.701107:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3e00/0xbacf56d076faaf71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969401.701120:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3e00/0xbacf56d076faaf71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969401.701131:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3e00/0xbacf56d076faaf71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969401.701156:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280572544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783969401.701231:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969401.701292:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac78613e300 going to sleep for 11 seconds 00000100:00100000:3.0:1783969401.701494:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280572544 00000100:00100000:3.0:1783969401.701501:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280572544 00000100:00100000:3.0:1783969401.701553:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1783969401.701563:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+16:5790:x1870627280572544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969401.701575:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969401.701589:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac781496800/0xbacf56d076faaf78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faaf71 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969401.701611:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac781496800/0xbacf56d076faaf78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faaf71 expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969401.701621:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac781496800/0xbacf56d076faaf78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faaf71 expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969401.701630:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac781496800, rc 0) 00000100:00100000:3.0:1783969401.701693:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280572544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969401.701700:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1783969401.701793:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280572544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969401.701808:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3e00/0xbacf56d076faaf71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaf78 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969401.701816:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3e00/0xbacf56d076faaf71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faaf78 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969401.701902:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a76c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280572672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969401.701941:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969401.701967:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba60b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969401.702156:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280572672 00000100:00100000:3.0:1783969401.702161:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280572672 00000100:00100000:3.0:1783969401.702199:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1783969401.702206:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280572672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969401.702453:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280572672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969401.702460:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1783969401.702548:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a76c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280572672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969401.702584:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280572800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969401.702626:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969401.702651:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b2feaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1783969401.702705:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280572800 00000100:00100000:0.0:1783969401.702709:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280572800 00000100:00100000:0.0:1783969401.702729:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1783969401.702735:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280572800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783969401.702910:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280572800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969401.702916:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1783969401.703287:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280572800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969401.703661:0:11531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:11531:1870627280572928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969401.703704:0:11531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969401.703741:0:11531:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b2feaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1783969401.703790:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280572928 00000100:00100000:0.0:1783969401.703801:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280572928 00000100:00100000:0.0:1783969401.703836:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1783969401.703844:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+17:11531:x1870627280572928:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969401.704394:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+17:11531:x1870627280572928:12345-0@lo:502:llog_process_th.0 Request processed in 550us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969401.704403:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1783969401.706746:0:11531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:11531:1870627280572928:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783969401.706792:0:11531:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783969401.706805:0:11531:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969401.706807:0:11531:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783969401.706815:0:11531:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ac7bf7a8800 00000020:00000080:1.0:1783969401.706818:0:11531:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783969401.707570:0:11531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:11531:1870627280573056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969401.707654:0:11531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969401.707702:0:11531:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac785110cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969401.707886:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280573056 00000100:00100000:3.0:1783969401.707893:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280573056 00000100:00100000:2.0:1783969401.708205:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1783969401.708225:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+17:11531:x1870627280573056:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783969401.708470:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+17:11531:x1870627280573056:12345-0@lo:502:llog_process_th.0 Request processed in 247us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969401.708478:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1783969401.708604:0:11531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:11531:1870627280573056:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783969401.708632:0:11531:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783969401.708639:0:11531:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783969401.708640:0:11531:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1783969401.708645:0:11531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1783969401.709403:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1783969401.709435:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783969401.709445:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3e00/0xbacf56d076faaf71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaf78 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969401.709457:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3e00/0xbacf56d076faaf71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaf78 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969401.709467:0:5790:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783969401.709469:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ac7ba5f7000 from 7 10000000:01000000:2.0:1783969401.709472:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783969401.709504:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faaf7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969401.709512:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faaf7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969401.709520:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faaf7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969401.709539:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280573184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783969401.709583:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969401.709623:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac78613ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1783969401.709722:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280573184 00000100:00100000:3.0:1783969401.709728:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280573184 00000100:00100000:3.0:1783969401.709768:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1783969401.709776:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+17:5790:x1870627280573184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969401.709788:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969401.709800:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac781496a00/0xbacf56d076faaf86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faaf7f expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969401.709822:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac781496a00/0xbacf56d076faaf86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faaf7f expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969401.709832:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac781496a00/0xbacf56d076faaf86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faaf7f expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969401.709840:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac781496a00, rc 0) 00000100:00100000:3.0:1783969401.710044:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280573184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969401.710081:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1783969401.710305:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280573184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783969401.710322:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faaf7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaf86 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969401.710332:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faaf7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faaf86 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969401.710388:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280573312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969401.710433:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969401.710463:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b2feaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1783969401.710539:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280573312 00000100:00100000:3.0:1783969401.710545:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280573312 00000100:00100000:3.0:1783969401.710579:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1783969401.710586:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280573312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969401.710816:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280573312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969401.710823:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1783969401.711035:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280573312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969401.711253:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280573440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969401.711301:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969401.711327:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b2feaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1783969401.711366:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280573440 00000100:00100000:3.0:1783969401.711370:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280573440 00000100:00100000:3.0:1783969401.711401:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1783969401.711408:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280573440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969401.711694:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280573440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 286us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969401.711703:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1783969401.716776:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280573440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783969401.723558:0:11533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a76c0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:11533:1870627280573568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969401.723630:0:11533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969401.723668:0:11533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba60b780 going to sleep for 11 seconds 00000100:00100000:1.0:1783969401.723764:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280573568 00000100:00100000:1.0:1783969401.723770:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280573568 00000100:00100000:1.0:1783969401.723811:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1783969401.723820:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+18:11533:x1870627280573568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969401.724540:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+18:11533:x1870627280573568:12345-0@lo:502:llog_process_th.0 Request processed in 719us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969401.724549:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000040:00080000:2.0:1783969401.729592:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783969401.731735:0:11533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a76c0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:11533:1870627280573568:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783969401.731807:0:11533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969401.731817:0:11533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969401.731820:0:11533:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783969401.731830:0:11533:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ac7ba5f7000 00000020:00000080:0.0:1783969401.731833:0:11533:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783969401.731945:0:11533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a76c0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:11533:1870627280573696:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969401.732012:0:11533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969401.732050:0:11533:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba60b780 going to sleep for 11 seconds 00000100:00100000:0.0:1783969401.732077:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280573696 00000100:00100000:0.0:1783969401.732082:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280573696 00000100:00100000:0.0:1783969401.732119:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1783969401.732127:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+18:11533:x1870627280573696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969401.732336:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782eb1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+18:11533:x1870627280573696:12345-0@lo:502:llog_process_th.0 Request processed in 208us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969401.732343:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1783969401.732387:0:11533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a76c0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:11533:1870627280573696:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783969401.732410:0:11533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969401.732423:0:11533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969401.732425:0:11533:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783969401.732429:0:11533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1783969401.734145:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1783969401.734173:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783969401.734194:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faaf7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaf86 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969401.734207:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faaf7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaf86 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969401.734216:0:5790:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783969401.734219:0:5790:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ac783021000 from 7 10000000:01000000:3.0:1783969401.734222:0:5790:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783969401.734257:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faaf8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969401.734273:0:5790:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faaf8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969401.734284:0:5790:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faaf8d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969401.734307:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681bf0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280573824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783969401.734362:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969401.734394:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7c1579600 going to sleep for 11 seconds 00000100:00100000:2.0:1783969401.734989:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280573824 00000100:00100000:2.0:1783969401.734996:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280573824 00000100:00100000:2.0:1783969401.735039:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1783969401.735048:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+18:5790:x1870627280573824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969401.735060:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969401.735073:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faaf94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076faaf8d expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969401.735096:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faaf94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076faaf8d expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969401.735106:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faaf94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076faaf8d expref: 19 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969401.735115:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c21e2c00, rc 0) 00000100:00100000:2.0:1783969401.735166:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+19:5790:x1870627280573824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969401.735173:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1783969401.736314:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681bf0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280573824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969401.736336:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faaf8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaf94 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969401.736347:0:5790:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faaf8d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faaf94 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969401.736415:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280573952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969401.736458:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969401.736483:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac78613e840 going to sleep for 11 seconds 00000100:00100000:2.0:1783969401.736514:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280573952 00000100:00100000:2.0:1783969401.736521:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280573952 00000100:00100000:2.0:1783969401.736552:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1783969401.736559:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:5790:x1870627280573952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969401.736807:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:5790:x1870627280573952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 247us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969401.736814:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1783969401.736878:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280573952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969401.736906:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280574080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969401.736941:0:5790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969401.736953:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac78613e840 going to sleep for 11 seconds 00000100:00100000:2.0:1783969401.736964:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280574080 00000100:00100000:2.0:1783969401.736967:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280574080 00000100:00100000:2.0:1783969401.736984:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1783969401.736990:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+19:5790:x1870627280574080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969401.737121:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+19:5790:x1870627280574080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969401.737128:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1783969401.737165:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c893ad09-f78f-4711-bea5-6489668294ed:5790:1870627280574080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969401.737330:0:11537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:11537:1870627280574208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783969401.737362:0:11537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969401.737380:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280574208 00000100:00100000:2.0:1783969401.737384:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280574208 00000100:00100000:2.0:1783969401.737405:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1783969401.737411:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:11537:x1870627280574208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783969401.737546:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:11537:x1870627280574208:12345-0@lo:502:llog_process_th.0 Request processed in 135us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969401.737553:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1783969401.737582:0:11537:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac78613e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969401.737593:0:11537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:11537:1870627280574208:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783969401.737613:0:11537:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783969401.737622:0:11537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969401.737625:0:11537:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783969401.737631:0:11537:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ac783021000 00000020:00000080:2.0:1783969401.737633:0:11537:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783969401.737692:0:11537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:11537:1870627280574336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783969401.737723:0:11537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969401.737741:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280574336 00000100:00100000:2.0:1783969401.737745:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280574336 00000100:00100000:2.0:1783969401.737766:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1783969401.737777:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:11537:x1870627280574336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783969401.737903:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:11537:x1870627280574336:12345-0@lo:502:llog_process_th.0 Request processed in 130us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969401.737910:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1783969401.737938:0:11537:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac78613e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969401.737950:0:11537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c893ad09-f78f-4711-bea5-6489668294ed:11537:1870627280574336:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783969401.737967:0:11537:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783969401.737971:0:11537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969401.737973:0:11537:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1783969401.737977:0:11537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1783969401.738017:0:5790:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1783969401.738039:0:5790:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783969401.738049:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faaf8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaf94 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969401.738059:0:5790:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faaf8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaf94 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969402.165200:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969402.165371:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272151936 00000100:00100000:2.0:1783969402.165382:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272151936 00000100:00100000:2.0:1783969402.165446:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 261 00000100:00100000:2.0:1783969402.165458:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+11:5581:x1870627272151936:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969402.165473:0:5786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969402.165490:0:5786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7c21e3c00/0xbacf56d076faaf9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb630fc expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969402.165531:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7c21e3c00/0xbacf56d076faaf9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630fc expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969402.165542:0:5786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7c21e3c00/0xbacf56d076faaf9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630fc expref: 12 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969402.165551:0:5786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c21e3c00, rc 0) 00000100:00100000:2.0:1783969402.165614:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+12:5581:x1870627272151936:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 Request processed in 158us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969402.165621:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 261 00000100:00100000:3.0:1783969402.170083:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969402.170382:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272152064 00000100:00100000:2.0:1783969402.170391:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272152064 00000100:00100000:2.0:1783969402.170455:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 262 00000100:00100000:2.0:1783969402.170465:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+12:5581:x1870627272152064:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969402.171141:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+12:5581:x1870627272152064:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 Request processed in 675us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969402.171151:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 262 00000100:00100000:0.0:1783969402.177068:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969402.177352:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272152192 00000100:00100000:3.0:1783969402.177362:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272152192 00000100:00100000:3.0:1783969402.177417:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 263 00000100:00100000:3.0:1783969402.177427:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+12:5581:x1870627272152192:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783969402.177645:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+12:5581:x1870627272152192:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 Request processed in 217us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969402.177653:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 263 00000100:00100000:3.0:1783969402.182126:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969402.182360:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272152320 00000100:00100000:2.0:1783969402.182370:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272152320 00000100:00100000:2.0:1783969402.182428:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 264 00000100:00100000:2.0:1783969402.182438:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+12:9937:x1870627272152320:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783969402.182904:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+12:9937:x1870627272152320:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 466us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969402.182913:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 264 00000100:00100000:1.0:1783969402.192407:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969402.192515:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272152448 00000100:00100000:0.0:1783969402.192526:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272152448 00000100:00100000:0.0:1783969402.192585:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 265 00000100:00100000:0.0:1783969402.192595:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+12:9937:x1870627272152448:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783969402.192945:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+12:9937:x1870627272152448:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 349us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969402.192953:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 265 00000100:00100000:0.0:1783969402.200527:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969402.201787:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272152576 00000100:00100000:2.0:1783969402.201800:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272152576 00000100:00100000:2.0:1783969402.201887:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 266 00000100:00100000:2.0:1783969402.201898:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+12:5581:x1870627272152576:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969402.201914:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969402.201931:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7c21e3400/0xbacf56d076faafa2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63103 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969402.201959:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7c21e3400/0xbacf56d076faafa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63103 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969402.201969:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7c21e3400/0xbacf56d076faafa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63103 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969402.201988:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c21e3400, rc 0) 00000100:00100000:2.0:1783969402.202062:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:5581:x1870627272152576:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 Request processed in 167us (1545us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969402.202083:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 266 00000100:00100000:1.0:1783969402.205264:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969402.205949:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272152704 00000100:00100000:3.0:1783969402.205959:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272152704 00000100:00100000:3.0:1783969402.206192:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 267 00000100:00100000:3.0:1783969402.206204:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:5581:x1870627272152704:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783969402.207148:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:5581:x1870627272152704:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 Request processed in 943us (1890us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969402.207169:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 267 00000100:00100000:1.0:1783969402.209411:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969402.209579:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272152832 00000100:00100000:0.0:1783969402.209588:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272152832 00000100:00100000:0.0:1783969402.209639:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 268 00000100:00100000:0.0:1783969402.209648:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:5581:x1870627272152832:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783969402.210162:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:5581:x1870627272152832:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 Request processed in 512us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969402.210171:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 268 00000100:00100000:0.0:1783969402.215157:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969402.216403:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272152960 00000100:00100000:3.0:1783969402.216415:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272152960 00000100:00100000:3.0:1783969402.216589:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 269 00000100:00100000:3.0:1783969402.216601:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:9940:x1870627272152960:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783969402.216902:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:9940:x1870627272152960:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 302us (1752us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969402.216911:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 269 00000100:00100000:1.0:1783969402.219413:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969402.219481:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272153088 00000100:00100000:0.0:1783969402.219547:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272153088 00000100:00100000:0.0:1783969402.219595:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 270 00000100:00100000:0.0:1783969402.219604:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:9940:x1870627272153088:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783969402.220157:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:9940:x1870627272153088:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 552us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969402.220173:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 270 00010000:00010000:0.0:1783969402.406510:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969402.432638:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969402.432718:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969402.439563:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969402.439596:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969402.439754:0:9934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272153472 00000100:00100000:3.0:1783969402.439764:0:9934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272153472 00000100:00100000:3.0:1783969402.439842:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 47 00000100:00100000:3.0:1783969402.439852:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+5:2348:x1870627272153472:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969402.439945:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785317b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+5:2348:x1870627272153472:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 94us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969402.439953:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 47 00000100:00100000:3.0:1783969402.440069:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272153216 00000100:00100000:3.0:1783969402.440074:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272153216 00000100:00100000:3.0:1783969402.440098:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 271 00000100:00100000:3.0:1783969402.440105:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2348:x1870627272153216:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969402.440134:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2348:x1870627272153216:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 29us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969402.440141:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 271 00000100:00080000:1.0:1783969402.440500:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783969402.445419:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272153344 00000100:00100000:0.0:1783969402.445433:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272153344 00000100:00100000:0.0:1783969402.445528:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272153600 00000100:00100000:0.0:1783969402.445532:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272153600 00000100:00100000:0.0:1783969402.445565:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 97 00000100:00100000:0.0:1783969402.445576:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+5:2348:x1870627272153344:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969402.445660:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+5:2348:x1870627272153344:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 85us (13029us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969402.445667:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 97 00000100:00100000:0.0:1783969402.445685:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 98 00000100:00100000:0.0:1783969402.445691:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2348:x1870627272153600:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969402.445715:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2348:x1870627272153600:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 25us (12998us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969402.445722:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 98 00000100:00080000:3.0:1783969402.445815:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1783969402.790504:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783969403.429091:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969404.453454:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969405.481650:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969405.541435:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783969405.541457:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a76c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280574464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783969405.541537:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969405.541629:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280574464 00000100:00100000:2.0:1783969405.541637:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280574464 00000100:00100000:2.0:1783969405.541714:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783969405.541724:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280574464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969405.541759:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783969405.541822:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280574464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969405.541830:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783969405.541920:0:3286:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1783969405.541926:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ac681bf2300, transno 4294967300 00000100:00100000:3.0:1783969405.541965:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a76c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280574464:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783969405.542002:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1783969405.601355:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:1.0:1783969406.053320:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a787d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1870627280574848:0@lo:400:kworker.0 00000100:00100000:1.0:1783969406.053410:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969406.053484:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1783969406.053490:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a787c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870627280574720:0@lo:400:kworker.0 00000100:00100000:1.0:1783969406.053515:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969406.053535:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280575232:0@lo:400:kworker.0 00000100:00100000:1.0:1783969406.053559:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969406.053597:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280574848 00000100:00100000:1.0:1783969406.053604:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280574848 00000100:00100000:1.0:1783969406.053647:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280574720 00000100:00100000:1.0:1783969406.053651:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280574720 00000100:00100000:1.0:1783969406.053671:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783969406.053678:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870627280574848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969406.053727:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870627280574848:12345-0@lo:400:kworker.0 Request processed in 49us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969406.053734:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783969406.053750:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783969406.053756:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870627280574720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969406.053782:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870627280574720:12345-0@lo:400:kworker.0 Request processed in 27us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969406.053788:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783969406.053805:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280575232 00000100:00100000:1.0:1783969406.053808:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280575232 00000100:00100000:1.0:1783969406.053846:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783969406.053852:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280575232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969406.053907:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280575232:12345-0@lo:400:kworker.0 Request processed in 54us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969406.053913:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783969406.053948:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a787c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870627280574720:0@lo:400:kworker.0 00010000:00080000:1.0:1783969406.053960:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7bf635c00 x1870627280575232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969406.053970:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280575232:0@lo:400:kworker.0 00000100:00100000:1.0:1783969406.053978:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a787d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1870627280574848:0@lo:400:kworker.0 00000100:00100000:0.0:1783969406.054457:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280574976:0@lo:400:kworker.0 00000100:00100000:0.0:1783969406.054493:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969406.054532:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783969406.054546:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280574592:0@lo:400:kworker.0 00000100:00100000:0.0:1783969406.054575:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969406.054598:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1870627280575104:0@lo:400:kworker.0 00000100:00100000:0.0:1783969406.054621:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783969406.054644:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783969406.054649:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969406.054658:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280575104 00000100:00100000:0.0:1783969406.054662:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280575104 00000100:00100000:0.0:1783969406.054694:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783969406.054700:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1870627280575104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969406.054737:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1870627280575104:12345-0@lo:400:kworker.0 Request processed in 37us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969406.054743:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783969406.054761:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280574592 00000100:00100000:0.0:1783969406.054764:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280574592 00000100:00100000:0.0:1783969406.054785:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1783969406.054791:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+19:3285:x1870627280574592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969406.054831:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+19:3285:x1870627280574592:12345-0@lo:400:kworker.0 Request processed in 28us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969406.054838:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:0.0:1783969406.054881:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969406.054899:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280574592:0@lo:400:kworker.0 00000100:00100000:0.0:1783969406.054910:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf635f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1870627280575104:0@lo:400:kworker.0 00000100:00100000:1.0:1783969406.055080:0:9934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280574976 00000100:00100000:1.0:1783969406.055085:0:9934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280574976 00000100:00100000:1.0:1783969406.055121:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783969406.055129:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280574976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969406.056596:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280574976:12345-0@lo:400:kworker.0 Request processed in 1463us (2096us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969406.056607:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783969406.058201:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280574976:0@lo:400:kworker.0 00010000:00010000:1.0:1783969406.501336:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969406.566220:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280575360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783969406.566295:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969406.566439:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280575360 00000100:00100000:0.0:1783969406.566447:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280575360 00000100:00100000:0.0:1783969406.566498:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783969406.566508:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280575360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783969406.566552:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783969406.566599:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280575360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969406.566606:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1783969406.566666:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7bff25880 x1870627280575360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969406.566687:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280575360:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783969407.525261:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969407.540995:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969407.541043:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969407.541083:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969407.541108:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272153728 00000100:00100000:2.0:1783969407.541119:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272153728 00000100:00100000:3.0:1783969407.541130:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969407.541169:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272153856 00000100:00100000:3.0:1783969407.541174:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272153856 00000100:00100000:2.0:1783969407.541184:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 273 00000100:00100000:2.0:1783969407.541195:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2349:x1870627272153728:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969407.541196:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272153984 00000100:00100000:1.0:1783969407.541200:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272153984 00000100:00100000:3.0:1783969407.541223:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272154112 00000100:00100000:3.0:1783969407.541228:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272154112 00000100:00100000:1.0:1783969407.541241:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 50 00000100:00100000:1.0:1783969407.541250:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+5:2349:x1870627272153984:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969407.541265:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 102 00000100:00100000:2.0:1783969407.541266:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2349:x1870627272153728:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 70us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969407.541277:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 273 00000100:00100000:3.0:1783969407.541282:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+5:2349:x1870627272153856:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969407.541283:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+5:2349:x1870627272153984:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 31us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969407.541295:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 50 00000100:00100000:2.0:1783969407.541329:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 103 00000100:00100000:2.0:1783969407.541337:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2349:x1870627272154112:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783969407.541368:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2349:x1870627272154112:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 31us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969407.541386:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 103 00000100:00080000:0.0:1783969407.541410:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783969407.541535:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969407.541667:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+5:2349:x1870627272153856:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 392us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969407.541684:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 102 00010000:00010000:0.0:1783969408.553618:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969409.573935:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969410.597159:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969410.662364:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a76c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280575488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969410.662440:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969410.662856:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280575488 00000100:00100000:0.0:1783969410.662898:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280575488 00000100:00100000:0.0:1783969410.662950:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783969410.662958:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280575488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783969410.662991:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783969410.663037:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280575488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969410.663043:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1783969410.663063:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969410.664450:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a76c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280575488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969411.175663:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a76c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280575616:0@lo:400:kworker.0 00000100:00100000:3.0:1783969411.175735:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969411.176672:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a76c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1870627280576128:0@lo:400:kworker.0 00000100:00100000:3.0:1783969411.176723:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969411.176752:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783969411.176880:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a76c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280576000:0@lo:400:kworker.0 00000100:00100000:3.0:1783969411.176909:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969411.176940:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a76c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280575744:0@lo:400:kworker.0 00000100:00100000:3.0:1783969411.176963:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969411.176983:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a76c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280576256:0@lo:400:kworker.0 00000100:00100000:3.0:1783969411.177003:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969411.177032:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969411.177038:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a76c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280575872:0@lo:400:kworker.0 00000100:00100000:3.0:1783969411.177059:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969411.177088:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280575616 00000100:00100000:3.0:1783969411.177095:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280575616 00000100:00100000:3.0:1783969411.177142:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1783969411.177152:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3286:x1870627280575616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969411.177197:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3286:x1870627280575616:12345-0@lo:400:kworker.0 Request processed in 47us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969411.177205:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1783969411.177234:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280576128 00000100:00100000:3.0:1783969411.177237:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280576128 00000100:00100000:3.0:1783969411.177267:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280575744 00000100:00100000:3.0:1783969411.177270:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280575744 00000100:00100000:3.0:1783969411.177284:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280575872 00000100:00100000:3.0:1783969411.177286:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280575872 00000100:00100000:3.0:1783969411.177298:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783969411.177303:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1870627280576128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969411.177334:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1870627280576128:12345-0@lo:400:kworker.0 Request processed in 30us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969411.177341:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783969411.177352:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783969411.177358:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280575744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969411.177385:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280575744:12345-0@lo:400:kworker.0 Request processed in 28us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969411.177391:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783969411.177400:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783969411.177405:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280575872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969411.177433:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280575872:12345-0@lo:400:kworker.0 Request processed in 28us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969411.177439:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783969411.177454:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280576000 00000100:00100000:3.0:1783969411.177456:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280576000 00000100:00100000:3.0:1783969411.177474:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280576256 00000100:00100000:3.0:1783969411.177476:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280576256 00000100:00100000:3.0:1783969411.177492:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783969411.177497:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280576000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969411.177522:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280576000:12345-0@lo:400:kworker.0 Request processed in 24us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969411.177527:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783969411.177536:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783969411.177541:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280576256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969411.179927:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280576256:12345-0@lo:400:kworker.0 Request processed in 2379us (2916us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969411.179942:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1783969411.179995:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783969411.180000:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969411.180060:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a76c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280575872:0@lo:400:kworker.0 00000100:00100000:3.0:1783969411.180073:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a76c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280575744:0@lo:400:kworker.0 00010000:00080000:3.0:1783969411.180086:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7a76c2d80 x1870627280576256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969411.180096:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a76c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280576256:0@lo:400:kworker.0 00000100:00100000:3.0:1783969411.180146:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a76c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280576000:0@lo:400:kworker.0 00000100:00100000:3.0:1783969411.180174:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a76c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280575616:0@lo:400:kworker.0 00000100:00100000:3.0:1783969411.180186:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a76c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1870627280576128:0@lo:400:kworker.0 00010000:00010000:0.0:1783969411.621115:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969411.685086:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969411.696966:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280576384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783969411.697042:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969411.697194:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280576384 00000100:00100000:0.0:1783969411.697202:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280576384 00000100:00100000:0.0:1783969411.697253:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783969411.697262:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280576384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783969411.697296:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783969411.697360:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280576384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969411.697367:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1783969411.698563:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7bff25c00 x1870627280576384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969411.698587:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280576384:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1783969412.006670:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783969412.648620:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969412.661687:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969412.661727:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969412.661774:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969412.661826:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272154240 00000100:00100000:0.0:1783969412.661842:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272154240 00000100:00100000:3.0:1783969412.661907:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272154496 00000100:00100000:3.0:1783969412.661913:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272154496 00000100:00100000:2.0:1783969412.661939:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272154368 00000100:00100000:0.0:1783969412.661945:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 275 00000100:00100000:2.0:1783969412.661946:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272154368 00000100:00100000:0.0:1783969412.661957:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b2f1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2349:x1870627272154240:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969412.661972:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 53 00000100:00100000:3.0:1783969412.661984:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+5:2349:x1870627272154496:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783969412.661995:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 107 00000100:00100000:2.0:1783969412.662004:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+5:2349:x1870627272154368:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969412.662100:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969412.663309:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+5:2349:x1870627272154496:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 1323us (1576us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969412.663319:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 53 00000100:00080000:3.0:1783969412.663356:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783969412.663361:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969412.663375:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272154624 00000100:00100000:3.0:1783969412.663381:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272154624 00000100:00100000:3.0:1783969412.663415:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 108 00000100:00100000:3.0:1783969412.663435:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2349:x1870627272154624:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969412.663627:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b2f1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2349:x1870627272154240:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 1671us (1948us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969412.663635:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2349:x1870627272154624:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 197us (1531us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969412.663641:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 275 00000100:00100000:3.0:1783969412.663648:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 108 00000100:00080000:3.0:1783969412.663795:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969412.670402:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+5:2349:x1870627272154368:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 8387us (8615us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969412.670417:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 107 00010000:00010000:0.0:1783969413.676169:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969414.693660:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969415.717190:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969415.782565:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783969415.782586:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280576512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969415.782649:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969415.783024:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280576512 00000100:00100000:1.0:1783969415.783032:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280576512 00000100:00100000:2.0:1783969415.783203:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783969415.783217:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280576512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969415.783258:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783969415.783374:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280576512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969415.783382:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783969415.783476:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280576512:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783969415.784085:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969416.293447:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280577024:0@lo:400:kworker.0 00000100:00100000:2.0:1783969416.293522:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969416.293578:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783969416.293585:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280576640:0@lo:400:kworker.0 00000100:00100000:3.0:1783969416.293592:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280577024 00000100:00100000:3.0:1783969416.293598:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280577024 00000100:00100000:2.0:1783969416.293611:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969416.293630:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1870627280577152:0@lo:400:kworker.0 00000100:00100000:3.0:1783969416.293638:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783969416.293646:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280577024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969416.293651:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969416.293674:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1870627280576896:0@lo:400:kworker.0 00000100:00100000:2.0:1783969416.293694:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969416.293698:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798167100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280577024:12345-0@lo:400:kworker.0 Request processed in 54us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969416.293705:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783969416.293722:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783969416.293727:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280576640 00000100:00100000:2.0:1783969416.293728:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870627280576768:0@lo:400:kworker.0 00000100:00100000:3.0:1783969416.293730:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280576640 00000100:00100000:2.0:1783969416.293750:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969416.293751:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1783969416.293756:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:3285:x1870627280576640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969416.293764:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac78872f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280577280:0@lo:400:kworker.0 00000100:00100000:2.0:1783969416.293780:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969416.293783:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:3285:x1870627280576640:12345-0@lo:400:kworker.0 Request processed in 27us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969416.293790:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1783969416.293816:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280577152 00000100:00100000:2.0:1783969416.293816:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280576896 00000100:00100000:3.0:1783969416.293820:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280577152 00000100:00100000:2.0:1783969416.293820:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280576896 00000100:00080000:1.0:1783969416.293933:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969416.293952:0:9934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280577280 00000100:00100000:1.0:1783969416.293955:0:9934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280577280 00000100:00100000:1.0:1783969416.293987:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783969416.293993:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280577280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969416.294035:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280577280:12345-0@lo:400:kworker.0 Request processed in 41us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969416.294040:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1783969416.294054:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783969416.294074:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac78872f480 x1870627280577280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969432 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969416.294087:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280577280:0@lo:400:kworker.0 00000100:00100000:3.0:1783969416.294209:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280576768 00000100:00100000:3.0:1783969416.294213:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280576768 00000100:00100000:2.0:1783969416.299280:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783969416.299305:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1870627280577152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969416.299398:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798166680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1870627280577152:12345-0@lo:400:kworker.0 Request processed in 105us (5744us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969416.299407:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783969416.299429:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783969416.299436:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870627280576896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969416.300232:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798167800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870627280576896:12345-0@lo:400:kworker.0 Request processed in 793us (6533us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969416.300241:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783969416.300260:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783969416.300268:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870627280576768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969416.300317:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798165500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870627280576768:12345-0@lo:400:kworker.0 Request processed in 50us (6566us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969416.300323:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783969416.300395:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280576640:0@lo:400:kworker.0 00000100:00100000:2.0:1783969416.300411:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1870627280577152:0@lo:400:kworker.0 00000100:00100000:2.0:1783969416.300423:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280577024:0@lo:400:kworker.0 00000100:00100000:2.0:1783969416.301384:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870627280576768:0@lo:400:kworker.0 00000100:00100000:2.0:1783969416.301398:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac78872e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1870627280576896:0@lo:400:kworker.0 00010000:00010000:0.0:1783969416.742188:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969416.805821:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969416.805844:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280577408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783969416.805921:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969416.806296:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280577408 00000100:00100000:1.0:1783969416.806304:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280577408 00000100:00100000:1.0:1783969416.806356:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783969416.806365:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280577408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783969416.806395:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783969416.806447:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280577408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969416.806454:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1783969416.806529:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7bff24700 x1870627280577408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969416.806544:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280577408:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783969417.766230:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969417.780738:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969417.780785:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969417.780905:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272154880 00000100:00100000:2.0:1783969417.780914:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272154880 00000100:00100000:2.0:1783969417.780986:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 112 00000100:00100000:2.0:1783969417.780996:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+5:2349:x1870627272154880:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783969417.781066:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+5:2349:x1870627272154880:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 71us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969417.781073:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 112 00000100:00080000:1.0:1783969417.781191:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969417.781405:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272154752 00000100:00100000:0.0:1783969417.781410:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272154752 00000100:00100000:0.0:1783969417.781450:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 277 00000100:00100000:0.0:1783969417.781458:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2349:x1870627272154752:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969417.781502:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2349:x1870627272154752:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 44us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969417.781509:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 277 00000100:00100000:3.0:1783969417.803648:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969417.803706:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969417.803918:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272155136 00000100:00100000:1.0:1783969417.803930:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272155136 00000100:00100000:1.0:1783969417.804007:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 113 00000100:00100000:1.0:1783969417.804018:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2349:x1870627272155136:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969417.804103:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2349:x1870627272155136:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 86us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969417.804110:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 113 00000100:00080000:2.0:1783969417.804279:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969417.804431:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272155008 00000100:00100000:0.0:1783969417.804438:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272155008 00000100:00100000:0.0:1783969417.804486:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:0.0:1783969417.804495:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+5:2347:x1870627272155008:12345-192.168.203.39@tcp:9:kworker.0 00000020:00000080:0.0:1783969417.804514:0:6594:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faaede 00000100:00080000:0.0:1783969417.804522:0:6594:0:(import.c:65:import_set_state_nolock()) ffff9ac7ba0dd000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783969417.804558:0:6594:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:2.0:1783969417.804884:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783969417.804984:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969417.805141:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+2:2347:x1870627272155008:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 645us (1499us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969417.805165:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 19 00010000:00010000:0.0:1783969418.790330:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969419.813608:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969420.837296:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969420.901489:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783969420.901512:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280577536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969420.901575:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969420.901697:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280577536 00000100:00100000:2.0:1783969420.901708:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280577536 00000100:00100000:2.0:1783969420.901768:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783969420.901778:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280577536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969420.901811:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783969420.901852:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280577536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969420.901874:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1783969420.901891:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969420.904897:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280577536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783969421.414042:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280578048:0@lo:400:kworker.0 00000100:00100000:2.0:1783969421.414118:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969421.414177:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783969421.414184:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280577664:0@lo:400:kworker.0 00000100:00100000:2.0:1783969421.414213:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969421.414245:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1870627280578176:0@lo:400:kworker.0 00000100:00100000:2.0:1783969421.414271:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969421.414296:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280577792:0@lo:400:kworker.0 00000100:00100000:2.0:1783969421.414319:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969421.414335:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280578304:0@lo:400:kworker.0 00000100:00100000:2.0:1783969421.414357:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969421.414373:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783969421.414378:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280577920:0@lo:400:kworker.0 00000100:00100000:2.0:1783969421.414398:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969421.414428:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280578048 00000100:00100000:2.0:1783969421.414434:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280578048 00000100:00100000:2.0:1783969421.414474:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280578304 00000100:00100000:2.0:1783969421.414477:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280578304 00000100:00100000:2.0:1783969421.414505:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783969421.414512:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280578048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969421.414561:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280578048:12345-0@lo:400:kworker.0 Request processed in 48us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969421.414568:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783969421.414583:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783969421.414589:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280578304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969421.414619:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280578304:12345-0@lo:400:kworker.0 Request processed in 31us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969421.414625:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783969421.414641:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280577664 00000100:00100000:2.0:1783969421.414645:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280577664 00000100:00100000:2.0:1783969421.414667:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1783969421.414672:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3285:x1870627280577664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969421.414708:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3285:x1870627280577664:12345-0@lo:400:kworker.0 Request processed in 36us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969421.414715:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1783969421.414741:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280578176 00000100:00100000:2.0:1783969421.414745:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280578176 00000100:00100000:2.0:1783969421.414769:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280577792 00000100:00100000:2.0:1783969421.414773:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280577792 00000100:00100000:2.0:1783969421.414786:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280577920 00000100:00100000:2.0:1783969421.414789:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280577920 00000100:00100000:2.0:1783969421.414805:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783969421.414809:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1870627280578176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969421.414838:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1870627280578176:12345-0@lo:400:kworker.0 Request processed in 28us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969421.414844:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783969421.414878:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783969421.414885:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280577792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969421.414912:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280577792:12345-0@lo:400:kworker.0 Request processed in 28us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969421.414918:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783969421.414929:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783969421.414934:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280577920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969421.414959:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280577920:12345-0@lo:400:kworker.0 Request processed in 25us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969421.414965:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:2.0:1783969421.414993:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783969421.414997:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783969421.415033:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7aead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280577920:0@lo:400:kworker.0 00000100:00100000:2.0:1783969421.415052:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7ae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280577792:0@lo:400:kworker.0 00010000:00080000:2.0:1783969421.415076:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7a7ae8700 x1870627280578304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969421.415087:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7ae8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280578304:0@lo:400:kworker.0 00000100:00100000:2.0:1783969421.415116:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7aea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280577664:0@lo:400:kworker.0 00000100:00100000:2.0:1783969421.415126:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7aeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1870627280578176:0@lo:400:kworker.0 00000100:00100000:2.0:1783969421.415134:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280578048:0@lo:400:kworker.0 00000001:00100000:1.0:1783969421.528998:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 03985e57-ffb4-414b-b30c-e72697857d4f 00000020:00000080:1.0:1783969421.529006:0:6622:0:(genops.c:906:class_export_put()) final put ffff9ac7ba0dc000/03985e57-ffb4-414b-b30c-e72697857d4f 00000020:00000080:0.0:1783969421.529073:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7ba0dc000/03985e57-ffb4-414b-b30c-e72697857d4f for lustre-OST0000 00000020:00000080:0.0:1783969421.529111:0:483:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ac7ba0dd000 for lustre-OST0000 00010000:00010000:0.0:1783969421.861025:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969421.926298:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969421.926318:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280578432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969421.926389:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969421.926447:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280578432 00000100:00100000:1.0:1783969421.926453:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280578432 00000100:00100000:1.0:1783969421.926496:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783969421.926504:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280578432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783969421.926608:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783969421.926649:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280578432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969421.926656:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1783969421.926694:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7bff26a00 x1870627280578432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969421.926721:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280578432:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1783969422.256281:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783969422.895057:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969422.904968:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969422.905006:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969422.905031:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969422.905066:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272155520 00000100:00100000:3.0:1783969422.905074:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272155520 00000100:00100000:3.0:1783969422.905123:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272155392 00000100:00100000:3.0:1783969422.905126:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272155392 00000100:00100000:3.0:1783969422.905149:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 117 00000100:00100000:3.0:1783969422.905159:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2348:x1870627272155520:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969422.905226:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2348:x1870627272155520:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 69us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969422.905234:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 117 00000100:00100000:3.0:1783969422.905250:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 118 00000100:00100000:3.0:1783969422.905257:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+5:2348:x1870627272155392:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969422.905283:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+5:2348:x1870627272155392:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 26us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969422.905289:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 118 00000100:00080000:3.0:1783969422.905308:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969422.905457:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272155264 00000100:00100000:0.0:1783969422.905461:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272155264 00000100:00100000:0.0:1783969422.905491:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 279 00000100:00100000:0.0:1783969422.905498:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2348:x1870627272155264:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969422.906569:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2348:x1870627272155264:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 1065us (1605us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969422.906580:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 279 00010000:00010000:3.0:1783969423.909038:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783969424.802816:0:11697:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 15:03:43 (1783969423) 00010000:00010000:0.0:1783969424.941014:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969425.958792:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969426.022002:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783969426.022035:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280578560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783969426.022107:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969426.022327:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280578560 00000100:00100000:1.0:1783969426.022336:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280578560 00000100:00100000:1.0:1783969426.022403:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783969426.022414:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280578560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783969426.022446:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783969426.022494:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1530000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280578560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969426.022501:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1783969426.023792:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969426.023850:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280578560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969426.534725:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c18e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280578816:0@lo:400:kworker.0 00000100:00100000:3.0:1783969426.534792:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969426.534878:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969426.534886:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c18e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280578944:0@lo:400:kworker.0 00000100:00100000:3.0:1783969426.534910:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969426.534945:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280578816 00000100:00100000:3.0:1783969426.534952:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280578816 00000100:00100000:3.0:1783969426.534992:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280578944 00000100:00100000:3.0:1783969426.534995:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280578944 00000100:00100000:3.0:1783969426.535021:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783969426.535042:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280578816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969426.535104:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280578816:12345-0@lo:400:kworker.0 Request processed in 63us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969426.535112:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783969426.535127:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1783969426.535133:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280578944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969426.535160:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280578944:12345-0@lo:400:kworker.0 Request processed in 27us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969426.535166:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1783969426.535189:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c18e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1870627280579072:0@lo:400:kworker.0 00000100:00100000:3.0:1783969426.535212:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969426.535230:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783969426.535235:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c18e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280578688:0@lo:400:kworker.0 00000100:00100000:3.0:1783969426.535261:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969426.535279:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1b9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280579200:0@lo:400:kworker.0 00000100:00100000:3.0:1783969426.535315:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969426.537294:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c18e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280578944:0@lo:400:kworker.0 00000100:00100000:0.0:1783969426.537311:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c18e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280578816:0@lo:400:kworker.0 00000100:00100000:2.0:1783969426.537535:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280579072 00000100:00100000:2.0:1783969426.537542:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280579072 00000100:00100000:2.0:1783969426.537608:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783969426.537617:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1870627280579072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969426.537679:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1870627280579072:12345-0@lo:400:kworker.0 Request processed in 63us (2465us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969426.537686:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783969426.537707:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280578688 00000100:00100000:2.0:1783969426.537711:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280578688 00000100:00100000:2.0:1783969426.537735:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1783969426.537741:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+19:3285:x1870627280578688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969426.537782:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+19:3285:x1870627280578688:12345-0@lo:400:kworker.0 Request processed in 41us (2520us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969426.537788:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1783969426.537817:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280579200 00000100:00100000:2.0:1783969426.537821:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280579200 00000100:00100000:2.0:1783969426.537881:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783969426.537888:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280579200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969426.537915:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280579200:12345-0@lo:400:kworker.0 Request processed in 29us (2600us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969426.537921:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1783969426.537941:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783969426.537945:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783969426.538303:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7c1b9a300 x1870627280579200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783969442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969426.538315:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1b9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280579200:0@lo:400:kworker.0 00000100:00100000:3.0:1783969426.538325:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c18e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1870627280579072:0@lo:400:kworker.0 00000100:00100000:3.0:1783969426.538410:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c18e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280578688:0@lo:400:kworker.0 00000100:00100000:1.0:1783969426.644928:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969426.645183:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272155648 00000100:00100000:3.0:1783969426.645192:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272155648 00000100:00100000:3.0:1783969426.645259:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 32 00000100:00100000:3.0:1783969426.645268:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+5:10209:x1870627272155648:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969426.645288:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969426.645311:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781497600/0xbacf56d076faafa9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6310a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969426.645369:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496c00/0xbacf56d076faafb0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969426.645381:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496c00/0xbacf56d076faafb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969426.645393:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496c00/0xbacf56d076faafb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969426.645571:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783969426.645576:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783969426.645668:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496c00/0xbacf56d076faafb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969426.645703:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781497600/0xbacf56d076faafa9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6310a expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783969426.645912:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783969426.646254:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496c00/0xbacf56d076faafb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6310a expref: 6 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969426.646263:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac78c550e00) 00010000:00010000:3.0:1783969426.646266:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783969426.646269:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac781496c00, rc 0) 00000100:00100000:3.0:1783969426.646389:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+6:10209:x1870627272155648:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 1120us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969426.646397:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 32 00000100:00100000:3.0:1783969426.654808:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969426.655191:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272155776 00000100:00100000:0.0:1783969426.655201:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272155776 00000100:00100000:0.0:1783969426.655264:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 33 00000100:00100000:0.0:1783969426.655275:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+6:10210:x1870627272155776:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783969426.655295:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969426.655315:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076faafb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63111 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.655396:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076faafbe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.655410:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076faafbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.655426:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076faafbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.655442:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92200/0xbacf56d076faafc5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.655450:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92200/0xbacf56d076faafc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.655457:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92200/0xbacf56d076faafc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.656240:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93600/0xbacf56d076faafcc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.656253:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93600/0xbacf56d076faafcc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.656262:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93600/0xbacf56d076faafcc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969426.656353:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1783969426.656357:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1783969426.656441:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93600/0xbacf56d076faafcc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.656466:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076faafbe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.656472:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076faafbe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.656480:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076faafbe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.656486:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969426.656491:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076faafbe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.656498:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076faafbe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.656510:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac78c550e00) 00010000:00010000:0.0:1783969426.656513:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969426.656518:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076faafbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.656525:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076faafbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.656536:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92200/0xbacf56d076faafc5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.656543:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92200/0xbacf56d076faafc5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.656549:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92200/0xbacf56d076faafc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.656560:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969426.656564:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92200/0xbacf56d076faafc5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.656571:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92200/0xbacf56d076faafc5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.656661:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ac790086400) 00010000:00010000:0.0:1783969426.656664:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969426.656668:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92200/0xbacf56d076faafc5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.656674:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92200/0xbacf56d076faafc5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.656769:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076faafb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63111 expref: 8 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.656786:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93600/0xbacf56d076faafcc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63111 expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.656794:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ac790086f00) 00010000:00010000:0.0:1783969426.656797:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783969426.656800:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93600, rc 0) 00000100:00100000:0.0:1783969426.657143:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+7:10210:x1870627272155776:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 1869us (2343us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969426.657152:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 33 00000100:00100000:1.0:1783969426.662650:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969426.663021:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272156032 00000100:00100000:0.0:1783969426.663054:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272156032 00000100:00100000:0.0:1783969426.663117:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 34 00000100:00100000:0.0:1783969426.663129:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+7:10210:x1870627272156032:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783969426.663149:0:10288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969426.663171:0:10288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076faafd3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63118 expref: -99 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.663245:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076faafda lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.663259:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076faafda lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.663272:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076faafda lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.663287:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076faafe1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.663294:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076faafe1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.663300:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076faafe1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.663806:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92c00/0xbacf56d076faafe8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.663817:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92c00/0xbacf56d076faafe8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.663826:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92c00/0xbacf56d076faafe8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969426.663844:0:10288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1783969426.665167:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076faafda lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.665181:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076faafda lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.665187:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076faafda lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.665193:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969426.665196:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076faafda lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.665204:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076faafda lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.665219:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ac790086f00) 00010000:00010000:0.0:1783969426.665221:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969426.665226:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076faafda lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.665232:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076faafda lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.665244:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076faafe1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.665251:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076faafe1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.665268:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076faafe1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.665273:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969426.665277:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076faafe1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.665283:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076faafe1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.665290:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ac790086b00) 00010000:00010000:0.0:1783969426.665293:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969426.665295:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076faafe1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.665301:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076faafe1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.665677:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076faafd3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63118 expref: 10 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.665693:0:10288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92c00/0xbacf56d076faafe8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63118 expref: 9 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969426.665700:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac790086e00) 00010000:00010000:0.0:1783969426.665703:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969426.665705:0:10288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92c00, rc 0) 00000100:00100000:0.0:1783969426.666067:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+9:10210:x1870627272156032:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 2940us (3425us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1783969426.666086:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 34 00000100:00100000:1.0:1783969426.671071:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969426.672010:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272156160 00000100:00100000:3.0:1783969426.672020:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272156160 00000100:00100000:3.0:1783969426.672092:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 35 00000100:00100000:3.0:1783969426.672101:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+9:10210:x1870627272156160:12345-192.168.203.39@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1783969426.672743:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+9:10210:x1870627272156160:12345-192.168.203.39@tcp:59:lhsmtool_posix.0 Request processed in 639us (1677us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969426.672847:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 35 00010000:00010000:1.0:1783969426.982789:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969427.045054:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783969427.045076:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280579328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783969427.045143:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969427.045239:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280579328 00000100:00100000:1.0:1783969427.045247:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280579328 00000100:00100000:1.0:1783969427.045304:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783969427.045313:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280579328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783969427.045346:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783969427.045396:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1531180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280579328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969427.045404:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1783969427.045439:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7bff26d80 x1870627280579328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969427.045458:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280579328:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1783969427.399413:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783969428.005083:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969428.025543:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969428.025594:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969428.025637:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969428.025723:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272156288 00000100:00100000:1.0:1783969428.025745:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272156288 00000100:00100000:1.0:1783969428.025793:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 281 00000100:00100000:1.0:1783969428.025801:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2349:x1870627272156288:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969428.025893:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2349:x1870627272156288:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 92us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969428.025901:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 281 00000100:00100000:3.0:1783969428.026092:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272156416 00000100:00100000:3.0:1783969428.026097:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272156416 00000100:00100000:3.0:1783969428.026143:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272156544 00000100:00100000:3.0:1783969428.026146:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272156544 00000100:00100000:3.0:1783969428.026226:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 122 00000100:00100000:3.0:1783969428.026235:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+9:2348:x1870627272156416:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969428.026283:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+9:2348:x1870627272156416:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 49us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969428.026290:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 122 00000100:00100000:3.0:1783969428.026308:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 123 00000100:00100000:3.0:1783969428.026314:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2349:x1870627272156544:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969428.026337:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2349:x1870627272156544:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 23us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969428.026344:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 123 00000100:00080000:1.0:1783969428.026564:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969428.934470:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969428.936134:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272156672 00000100:00100000:3.0:1783969428.936147:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272156672 00000100:00100000:3.0:1783969428.936209:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 36 00000100:00100000:3.0:1783969428.936219:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+9:10253:x1870627272156672:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783969428.936238:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969428.936257:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781497600/0xbacf56d076faaff6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6311f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969428.936329:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faaffd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969428.936343:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faaffd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969428.936356:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faaffd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969428.936371:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7e00/0xbacf56d076fab004 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969428.936399:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7e00/0xbacf56d076fab004 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969428.936407:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7e00/0xbacf56d076fab004 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969428.937042:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faaffd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969428.937052:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faaffd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969428.937067:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faaffd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969428.937074:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac781496200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969428.937078:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faaffd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969428.937085:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faaffd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969428.937097:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac78c550e00) 00010000:00010000:3.0:1783969428.937100:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969428.937105:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faaffd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969428.937112:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076faaffd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969428.937123:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7e00/0xbacf56d076fab004 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969428.937136:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7e00/0xbacf56d076fab004 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969428.937141:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7e00/0xbacf56d076fab004 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969428.937146:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de7e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969428.937149:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7e00/0xbacf56d076fab004 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969428.937155:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7e00/0xbacf56d076fab004 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969428.937162:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ac78c550100) 00010000:00010000:3.0:1783969428.937165:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969428.937167:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7e00/0xbacf56d076fab004 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969428.937172:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7e00/0xbacf56d076fab004 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969428.937205:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781497600/0xbacf56d076faaff6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6311f expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969428.937215:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac78c550e00) 00010000:00010000:3.0:1783969428.937217:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969428.937221:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781497600/0xbacf56d076faaff6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6311f expref: 10 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969428.937229:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac781497600, rc 0) 00000100:00100000:3.0:1783969428.937294:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+9:10253:x1870627272156672:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1077us (2831us total) trans 0 rc 301/301 00000100:00100000:3.0:1783969428.937301:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 36 00000100:00100000:3.0:1783969428.942430:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969428.949710:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272156928 00000100:00100000:1.0:1783969428.949724:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272156928 00000100:00100000:1.0:1783969428.949805:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 37 00000100:00100000:1.0:1783969428.949816:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+9:10253:x1870627272156928:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:1.0:1783969428.949884:0:6618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969428.949909:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496c00/0xbacf56d076faafb0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6310a expref: 9 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969428.949927:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac78c550e00) 00010000:00010000:1.0:1783969428.949936:0:6618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783969428.950240:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab00b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969428.950255:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab00b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969428.950266:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab00b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969428.950279:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab012 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969428.950299:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab012 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969428.950307:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab012 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969428.956629:0:6618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1783969428.956651:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab00b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969428.956662:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab00b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969428.956670:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab00b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969428.956676:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60f400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969428.956681:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab00b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969428.956688:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab00b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969428.956705:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac7829e0100) 00010000:00010000:1.0:1783969428.956708:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969428.956713:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab00b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969428.956719:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab00b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783969428.956750:0:6618:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eeda3550 reply state 00000000ed5d23b1 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab012 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969428.956759:0:6618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783969428.959518:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+10:10253:x1870627272156928:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 9691us (17086us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1783969428.959530:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 37 00010000:00010000:2.0:1783969428.965159:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab012 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969428.965177:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab012 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969428.965185:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab012 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969428.965202:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60e000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969428.965206:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab012 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969428.965213:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab012 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969428.965228:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ac7829e0600) 00010000:00010000:2.0:1783969428.965231:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969428.965235:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab012 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969428.965241:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab012 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.036088:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969429.036152:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969429.036181:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272157056 00000100:00100000:3.0:1783969429.036190:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272157056 00000100:00100000:3.0:1783969429.036239:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 38 00000100:00100000:3.0:1783969429.036249:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+9:10261:x1870627272157056:12345-192.168.203.39@tcp:101:lctl.0 00010000:00010000:3.0:1783969429.036271:0:10288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969429.036293:0:10288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab019 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63126 expref: -99 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.036677:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7e00/0xbacf56d076fab020 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.036692:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7e00/0xbacf56d076fab020 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.036704:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7e00/0xbacf56d076fab020 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969429.037403:0:10288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783969429.037408:0:10288:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1783969429.037450:0:10288:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7e00/0xbacf56d076fab020 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.037478:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab019 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63126 expref: 11 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.037782:0:10288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7e00/0xbacf56d076fab020 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63126 expref: 10 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.037793:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac78c550100) 00010000:00010000:3.0:1783969429.037796:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783969429.038244:0:10288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7e00, rc 0) 00000100:00100000:3.0:1783969429.038310:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+10:10261:x1870627272157056:12345-192.168.203.39@tcp:101:lctl.0 Request processed in 2062us (2162us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969429.038386:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 38 00000100:00100000:3.0:1783969429.091273:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969429.091436:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272157184 00000100:00100000:0.0:1783969429.091447:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272157184 00000100:00100000:0.0:1783969429.091520:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 39 00000100:00100000:0.0:1783969429.091530:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+10:10267:x1870627272157184:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:0.0:1783969429.091561:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969429.091582:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab027 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6312d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.091655:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab02e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.091668:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab02e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.091679:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab02e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.091695:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab035 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.091702:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab035 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.091709:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab035 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.091835:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92200/0xbacf56d076fab03c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.091893:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92200/0xbacf56d076fab03c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.091902:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92200/0xbacf56d076fab03c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969429.091935:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1783969429.091939:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783969429.091977:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92200/0xbacf56d076fab03c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.091989:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab02e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.091994:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab02e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.092001:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab02e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.092015:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969429.092019:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab02e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.092026:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab02e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.092037:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac78c550100) 00010000:00010000:0.0:1783969429.092040:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969429.092045:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab02e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.092061:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab02e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.092074:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab035 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.092079:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab035 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.092084:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab035 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.092088:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969429.092091:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab035 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.092096:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab035 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.092110:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ac790086400) 00010000:00010000:0.0:1783969429.092112:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969429.092114:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab035 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.092119:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab035 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.092148:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab027 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6312d expref: 12 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.092161:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92200/0xbacf56d076fab03c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6312d expref: 11 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.092174:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:0.0:1783969429.092177:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783969429.092179:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92200, rc 0) 00000100:00100000:0.0:1783969429.092235:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+11:10267:x1870627272157184:12345-192.168.203.39@tcp:101:bash.0 Request processed in 707us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969429.092242:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 39 00000100:00100000:0.0:1783969429.096195:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969429.096364:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272157440 00000100:00100000:1.0:1783969429.096373:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272157440 00000100:00100000:1.0:1783969429.096478:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 40 00000100:00100000:1.0:1783969429.096497:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+11:10267:x1870627272157440:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:1.0:1783969429.096518:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969429.096550:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab043 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63134 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.096676:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab04a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.096691:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab04a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.096702:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab04a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.096759:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab051 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.096767:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab051 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.096793:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab051 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783969429.097377:0:6618:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1783969429.097546:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab058 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.097557:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab058 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.097565:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab058 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.097597:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab04a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.097604:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab04a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.097610:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab04a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.097616:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60e200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969429.097621:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab04a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.097629:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab04a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.097641:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:1.0:1783969429.097645:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969429.097656:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab04a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.097663:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab04a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783969429.097678:0:6618:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006c522beb reply state 000000009c73de95 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab051 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969429.097686:0:6618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783969429.097734:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab043 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63134 expref: 14 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.097753:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab058 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63134 expref: 13 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.097762:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac7829e0500) 00010000:00010000:1.0:1783969429.097764:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783969429.097767:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bf60f600, rc 0) 00000100:00100000:1.0:1783969429.097842:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+14:10267:x1870627272157440:12345-192.168.203.39@tcp:101:bash.0 Request processed in 1355us (1656us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1783969429.097849:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 40 00010000:00010000:2.0:1783969429.102652:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab051 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.102670:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab051 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.102677:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab051 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.102684:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60ee00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969429.102688:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab051 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.102695:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab051 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.102727:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ac7829e0100) 00010000:00010000:2.0:1783969429.102730:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969429.102735:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab051 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.102741:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab051 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969429.105323:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969429.108246:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272157568 00000100:00100000:2.0:1783969429.108260:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272157568 00000100:00100000:0.0:1783969429.108374:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:0.0:1783969429.108383:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1870627272157568:12345-192.168.203.39@tcp:8:bash.0 00010000:00080000:0.0:1783969429.108417:0:6594:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 03985e57-ffb4-414b-b30c-e72697857d4f@192.168.203.39@tcp t0 exp 0000000000000000 cur 286 last 0 00000020:00000080:0.0:1783969429.108449:0:6594:0:(genops.c:1406:class_connect()) connect: client 03985e57-ffb4-414b-b30c-e72697857d4f, cookie 0xbacf56d076fab066 00002000:00100000:0.0:1783969429.108462:0:6594:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 03985e57-ffb4-414b-b30c-e72697857d4f/ffff9ac7ba0d8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783969429.108483:0:6594:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:0.0:1783969429.109843:0:6594:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783969429.109918:0:6594:0:(import.c:65:import_set_state_nolock()) ffff9ac7ba0dd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783969429.109996:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+6:2347:x1870627272157568:12345-192.168.203.39@tcp:8:bash.0 Request processed in 1611us (4685us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969429.110005:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:3.0:1783969429.115603:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969429.115747:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272157696 00000100:00100000:2.0:1783969429.115757:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272157696 00000100:00100000:2.0:1783969429.115844:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:2.0:1783969429.115855:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+6:0:x1870627272157696:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:2.0:1783969429.115904:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969429.115938:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf749bed/0xbacf56d076fab06d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6313b expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783969429.115965:0:6593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783969429.115984:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=286s v=(0 0) 00010000:00010000:2.0:1783969429.115989:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969429.115997:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf749bed/0xbacf56d076fab06d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6313b expref: 7 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.116026:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cf749bed/0xbacf56d076fab06d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6313b expref: 7 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.116057:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c2045400, rc 0) 00000100:00100000:2.0:1783969429.116217:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+7:0:x1870627272157696:12345-192.168.203.39@tcp:101:bash.0 Request processed in 363us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969429.116225:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00080000:1.0:1783969429.118654:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783969429.119574:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969429.120210:0:9934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272157824 00000100:00100000:2.0:1783969429.120219:0:9934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272157824 00000100:00100000:2.0:1783969429.120279:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:2.0:1783969429.120288:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+7:10267:x1870627272157824:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:2.0:1783969429.120307:0:9934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969429.120335:0:9934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046ac9c32/0xbacf56d076fab074 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63142 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.120367:0:9934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf749bed/0xbacf56d076fab06d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6313b expref: 8 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.120376:0:9934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969429.120381:0:9934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969429.120386:0:9934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046ac9c32/0xbacf56d076fab074 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63142 expref: 8 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.120420:0:9934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cf749bed/0xbacf56d076fab06d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6313b expref: 8 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.120769:0:9934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cf749bed/0xbacf56d076fab06d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6313b expref: 8 pid: 6593 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969429.120798:0:9934:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1532a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9934:1870627280579456:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783969429.121032:0:9934:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac786283300 going to sleep for 11 seconds 00000100:00100000:0.0:1783969429.128716:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969429.128930:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272157952 00000100:00100000:1.0:1783969429.128938:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272157952 00010000:00010000:1.0:1783969429.128976:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cf749bed/0xbacf56d076fab06d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6313b expref: 9 pid: 6593 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969429.129025:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 35 00000100:00100000:1.0:1783969429.129035:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+9:2351:x1870627272157952:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969429.129084:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969429.129119:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cf749bed/0xbacf56d076fab06d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6313b expref: 9 pid: 6593 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.129133:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cf749bed/0xbacf56d076fab06d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6313b expref: 9 pid: 6593 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.129159:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969429.129164:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969429.129173:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046ac9c32/0xbacf56d076fab074 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63142 expref: 9 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.129183:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046ac9c32/0xbacf56d076fab074 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63142 expref: 9 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.129220:0:5778:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000046ac9c32/0xbacf56d076fab074 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63142 expref: 9 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969429.129233:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff26d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5778:1870627280579584:192.168.203.39@tcp:105: 00000100:00100000:1.0:1783969429.129303:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7ba60bc00 going to sleep for 11 seconds 00010000:00010000:2.0:1783969429.130183:0:9934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf749bed/0xbacf56d076fab06d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6313b expref: 9 pid: 6593 timeout: 386 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969429.130202:0:9934:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1532a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9934:1870627280579456:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969429.130225:0:9934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000046ac9c32/0xbacf56d076fab074 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63142 expref: 8 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.130238:0:9934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c2045a00, rc 0) 00000100:00100000:2.0:1783969429.130288:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+8:10267:x1870627272157824:12345-192.168.203.39@tcp:101:bash.0 Request processed in 10001us (10719us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969429.130295:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:1.0:1783969429.147197:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff26d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5778:1870627280579584:192.168.203.39@tcp:105: 00010000:00010000:1.0:1783969429.147224:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969429.147280:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+7:2351:x1870627272157952:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 18246us (18573us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969429.147291:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 35 00000100:00100000:3.0:1783969429.155621:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969429.156218:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272158208 00000100:00100000:0.0:1783969429.156230:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272158208 00000100:00100000:0.0:1783969429.156293:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:0.0:1783969429.156303:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+13:10267:x1870627272158208:12345-192.168.203.39@tcp:35:bash.0 00000100:00100000:0.0:1783969429.156665:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+14:10267:x1870627272158208:12345-192.168.203.39@tcp:35:bash.0 Request processed in 363us (1053us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1783969429.156674:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:1.0:1783969429.280674:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969429.281016:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272158464 00000100:00100000:3.0:1783969429.281025:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272158464 00000100:00100000:3.0:1783969429.281224:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 41 00000100:00100000:3.0:1783969429.281234:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+14:10277:x1870627272158464:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783969429.281257:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969429.281275:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab07b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63149 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969429.281392:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1783969429.281496:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab07b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63149 expref: 16 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.281525:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac78c550100) 00010000:00010000:3.0:1783969429.281528:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783969429.281534:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab07b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63149 expref: 16 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.281546:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7400, rc 0) 00000100:00100000:3.0:1783969429.281604:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+15:10277:x1870627272158464:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 372us (939us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1783969429.281611:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 41 00000100:00100000:3.0:1783969429.285263:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969429.285450:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272158720 00000100:00100000:0.0:1783969429.285460:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272158720 00000100:00100000:0.0:1783969429.285520:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:0.0:1783969429.285530:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+15:10277:x1870627272158720:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1783969429.285784:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+16:10277:x1870627272158720:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 255us (529us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1783969429.285792:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:1.0:1783969429.362797:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969429.362943:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272158848 00000100:00100000:3.0:1783969429.362951:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272158848 00000100:00100000:3.0:1783969429.363032:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 42 00000100:00100000:3.0:1783969429.363043:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+16:10283:x1870627272158848:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783969429.363231:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969429.363252:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab089 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63150 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.363330:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab090 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.363342:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab090 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.363354:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab090 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969429.363428:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1783969429.363432:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783969429.363452:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab090 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.363478:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab089 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63150 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.363495:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab090 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63150 expref: 17 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.363504:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:3.0:1783969429.363507:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783969429.363511:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7400, rc 0) 00000100:00100000:3.0:1783969429.363571:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+17:10283:x1870627272158848:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 531us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969429.363579:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 42 00000100:00100000:2.0:1783969429.368985:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969429.369173:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272159104 00000100:00100000:1.0:1783969429.369182:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272159104 00000100:00100000:1.0:1783969429.369239:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 43 00000100:00100000:1.0:1783969429.369249:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+17:10283:x1870627272159104:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1783969429.369268:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969429.369286:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab097 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63157 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.369391:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab09e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.369406:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab09e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.369417:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab09e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969429.369428:0:6618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1783969429.369549:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab097 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63157 expref: 20 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.369568:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab09e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63157 expref: 19 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.369576:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac7829e0500) 00010000:00010000:1.0:1783969429.369579:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783969429.369583:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bf60fe00, rc 0) 00000100:00100000:1.0:1783969429.369642:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+19:10283:x1870627272159104:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 395us (666us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1783969429.369661:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 43 00000100:00100000:0.0:1783969429.373396:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969429.373482:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272159360 00000100:00100000:3.0:1783969429.373491:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272159360 00000100:00100000:3.0:1783969429.373546:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 44 00000100:00100000:3.0:1783969429.373555:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+19:10283:x1870627272159360:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783969429.373577:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969429.373597:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab0ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6315e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.373683:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab0b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.373723:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab0b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.373735:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab0b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969429.373749:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783969429.373874:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab0ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6315e expref: 22 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.373893:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab0b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6315e expref: 21 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.373901:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac7829e0500) 00010000:00010000:3.0:1783969429.373903:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783969429.373906:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7600, rc 0) 00000100:00100000:3.0:1783969429.374278:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+21:10283:x1870627272159360:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 722us (890us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1783969429.374286:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 44 00000100:00100000:2.0:1783969429.377162:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969429.382818:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969429.383109:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272159616 00000100:00100000:2.0:1783969429.383119:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272159616 00000100:00100000:2.0:1783969429.383176:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 23 00000100:00100000:2.0:1783969429.383187:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+7:2351:x1870627272159616:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1783969429.383230:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d0a748a/0xbacf56d076fab0c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.383250:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000046ac9c32/0xbacf56d076fab074 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63142 expref: 7 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.383271:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969429.383276:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783969429.383280:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d0a748a/0xbacf56d076fab0c1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.383323:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000046ac9c32/0xbacf56d076fab074 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63142 expref: 7 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.383336:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000046ac9c32/0xbacf56d076fab074 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63142 expref: 7 pid: 9934 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969429.383351:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7aeaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6593:1870627280579712:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783969429.386887:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969429.386941:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272159744 00000100:00100000:3.0:1783969429.386950:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272159744 00002000:00100000:3.0:1783969429.386993:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9ac7c1b99880 x1870627272159744/t0(0) o4->03985e57-ffb4-414b-b30c-e72697857d4f@192.168.203.39@tcp:325/0 lens 504/0 e 0 to 0 dl 1783969440 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783969429.387017:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac7c1b99880 with x1870627272159744 ext(0->12) 00010000:00010000:3.0:1783969429.387027:0:6598:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000046ac9c32/0xbacf56d076fab074 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63142 expref: 8 pid: 9934 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.387052:0:6598:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000046ac9c32/0xbacf56d076fab074 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63142 expref: 8 pid: 9934 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783969429.387070:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ac7c1b99880 00000100:00100000:3.0:1783969429.387099:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:3.0:1783969429.387109:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:03985e57-ffb4-414b-b30c-e72697857d4f+8:2350:x1870627272159744:12345-192.168.203.39@tcp:4:lfs.0 00000100:00100000:1.0:1783969429.388421:0:8304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272159488 00000100:00100000:1.0:1783969429.388433:0:8304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272159488 00000100:00100000:1.0:1783969429.388525:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00100000:1.0:1783969429.388534:0:8304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7aeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+21:2349:x1870627272159488:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969429.388546:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969429.388569:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab09e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63157 expref: 21 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.388587:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac7829e0500) 00010000:00010000:1.0:1783969429.388592:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969429.388644:0:8304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7aeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+20:2349:x1870627272159488:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 111us (11582us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969429.388651:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00100000:2.0:1783969429.393181:0:6593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac786283300 going to sleep for 11 seconds 00000100:00100000:2.0:1783969429.393225:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7aeaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6593:1870627280579712:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969429.393265:0:6593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006d0a748a/0xbacf56d076fab0c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1783969429.422491:0:7494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 03985e57-ffb4-414b-b30c-e72697857d4f 00000001:00080000:1.0:1783969429.455248:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1783969429.455469:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:03985e57-ffb4-414b-b30c-e72697857d4f+7:2350:x1870627272159744:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 68355us (68603us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1783969429.455482:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 0 00002000:00100000:3.0:1783969429.455495:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9ac7c1b99880 x1870627272159744/t4294967299(0) o4->03985e57-ffb4-414b-b30c-e72697857d4f@192.168.203.39@tcp:325/0 lens 504/448 e 0 to 0 dl 1783969440 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783969429.455504:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac7c1b99880 with x1870627272159744 ext(0->12) 00010000:00010000:3.0:1783969429.455514:0:6598:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000046ac9c32/0xbacf56d076fab074 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63142 expref: 7 pid: 9934 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.455530:0:6598:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000046ac9c32/0xbacf56d076fab074 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63142 expref: 7 pid: 9934 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783969429.455538:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ac7c1b99880 00000100:00100000:3.0:1783969429.458687:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969429.459174:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272159872 00000100:00100000:1.0:1783969429.459184:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272159872 00010000:00010000:0.0:1783969429.459302:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000046ac9c32/0xbacf56d076fab074 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63142 expref: 7 pid: 9934 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969429.459442:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 36 00000100:00100000:0.0:1783969429.459452:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+7:2351:x1870627272159872:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969429.459467:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783969429.459485:0:5779:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783969429.459488:0:5779:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1783969429 00002000:00010000:0.0:1783969429.459490:0:5779:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1783969429 00002000:00010000:0.0:1783969429.459492:0:5779:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1783969429 00002000:00010000:0.0:1783969429.459494:0:5779:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1783969429.459500:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000046ac9c32/0xbacf56d076fab074 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63142 expref: 7 pid: 9934 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.459532:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000046ac9c32/0xbacf56d076fab074 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63142 expref: 7 pid: 9934 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.459555:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046ac9c32/0xbacf56d076fab074 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63142 expref: 7 pid: 9934 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.459573:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783969429.459577:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783969429.459583:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006d0a748a/0xbacf56d076fab0c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.459593:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d0a748a/0xbacf56d076fab0c1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.459627:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969429.459679:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+6:2351:x1870627272159872:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 228us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969429.459687:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 36 00010000:00010000:2.0:1783969429.459745:0:6593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006d0a748a/0xbacf56d076fab0c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.459755:0:6593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d0a748a/0xbacf56d076fab0c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.459778:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d0a748a/0xbacf56d076fab0c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.459793:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d0a748a/0xbacf56d076fab0c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.460001:0:6593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d0a748a/0xbacf56d076fab0c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.460017:0:6593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2045200 already unused, calling callback (ffffffffc1485230) 00010000:00010000:2.0:1783969429.460022:0:6593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d0a748a/0xbacf56d076fab0c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.460031:0:6593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d0a748a/0xbacf56d076fab0c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.460043:0:6593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d0a748a/0xbacf56d076fab0c1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.460050:0:6593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d0a748a/0xbacf56d076fab0c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969429.460170:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+5:2351:x1870627272159616:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 76983us (77359us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969429.460178:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 23 00000100:00100000:2.0:1783969429.462770:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969429.462907:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272160128 00000100:00100000:3.0:1783969429.462916:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272160128 00000100:00100000:3.0:1783969429.462977:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:3.0:1783969429.462999:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+20:10283:x1870627272160128:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:3.0:1783969429.463221:0:5796:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab0b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6315e expref: 20 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783969429.463488:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1783969429.463545:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1783969429.464599:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1783969429.464662:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab0c8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.464679:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab058 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63134 expref: 24 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.464689:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab0c8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.464737:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab058 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63134 expref: 24 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.464753:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab058 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63134 expref: 24 pid: 6618 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969429.464768:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1b9a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5796:1870627280579840:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783969429.465296:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7877cd180 going to sleep for 11 seconds 00000100:00100000:1.0:1783969429.472375:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969429.472447:0:8304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272160256 00000100:00100000:2.0:1783969429.472456:0:8304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272160256 00010000:00010000:2.0:1783969429.472505:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab058 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63134 expref: 25 pid: 6618 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969429.472547:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 37 00000100:00100000:2.0:1783969429.472556:0:8304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+25:2350:x1870627272160256:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969429.472569:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969429.472575:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab058 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63134 expref: 25 pid: 6618 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.472588:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab058 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63134 expref: 25 pid: 6618 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.472609:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac7829e0500) 00010000:00010000:2.0:1783969429.472614:0:8304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab0c8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.472623:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab0c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.472630:0:8304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab0c8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.472649:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969429.472702:0:8304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+25:2350:x1870627272160256:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 146us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969429.472722:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 37 00010000:00010000:3.0:1783969429.476185:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab058 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63134 expref: 24 pid: 6618 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969429.476210:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1b9a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5796:1870627280579840:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783969429.476250:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab0c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.476419:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab0c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.476428:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab0c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783969429.476545:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1783969429.476735:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1783969429.477245:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7aea680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5796:1870627280579968:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783969429.477356:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969429.477383:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac786283c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783969429.477412:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280579968 00000100:00100000:2.0:1783969429.477418:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280579968 00000100:00100000:2.0:1783969429.477466:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783969429.477475:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5796:x1870627280579968:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783969429.477538:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7ae8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5796:x1870627280579968:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 65us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969429.477546:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783969429.477579:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7aea680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5796:1870627280579968:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1783969429.478503:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1783969429.478568:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7aea680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5796:1870627280580096:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783969429.478607:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969429.478638:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac786283000 going to sleep for 11 seconds 00000100:00080000:2.0:1783969429.479057:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783969429.479181:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280580096 00000100:00100000:3.0:1783969429.479187:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280580096 00000100:00100000:3.0:1783969429.479222:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783969429.479230:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5796:x1870627280580096:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783969429.479470:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7ae8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5796:x1870627280580096:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 240us (861us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1783969429.479476:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783969429.479598:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7aea680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5796:1870627280580096:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1783969429.479653:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1783969429.479689:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab0c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.479699:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab0c8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.479718:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab0c8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.479725:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de7800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969429.479729:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab0c8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.479737:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab0c8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.479752:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac7829e0500) 00010000:00010000:2.0:1783969429.479755:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1783969429.479759:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab0c8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.479765:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab0c8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783969429.480547:0:5796:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1783969429.481163:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1783969429.481178:0:5796:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 286563317356ns, next at 287563314150ns, rc = 0 00000001:00080000:2.0:1783969429.481186:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1783969429.481232:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac7829e0500) 00010000:00010000:2.0:1783969429.481236:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783969429.481245:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab0b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6315e expref: 28 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969429.481668:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+27:10283:x1870627272160128:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 18668us (18903us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1783969429.481693:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 8 00000020:00080000:2.0:1783969429.481698:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783969429.486537:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969429.486730:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272160384 00000100:00100000:0.0:1783969429.486740:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272160384 00000100:00100000:0.0:1783969429.486806:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 45 00000100:00100000:0.0:1783969429.486817:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+27:10283:x1870627272160384:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783969429.486839:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969429.486890:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab0cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63165 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.487180:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab0cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63165 expref: 28 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.487196:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab0cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63165 expref: 28 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.487215:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086600) 00010000:00010000:0.0:1783969429.487218:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783969429.487221:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93c00, rc 0) 00000100:00100000:0.0:1783969429.487284:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+28:10283:x1870627272160384:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 468us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969429.487291:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 45 00000100:00100000:0.0:1783969429.491965:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969429.492299:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272160640 00000100:00100000:1.0:1783969429.492309:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272160640 00000100:00100000:1.0:1783969429.492374:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:1.0:1783969429.492384:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786070c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+28:10283:x1870627272160640:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1783969429.492784:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786070c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+29:10283:x1870627272160640:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 400us (825us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1783969429.492793:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:2.0:1783969429.559346:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969429.559523:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272160896 00000100:00100000:0.0:1783969429.559532:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272160896 00000100:00100000:0.0:1783969429.559621:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 46 00000100:00100000:0.0:1783969429.559631:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7aead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+29:10293:x1870627272160896:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783969429.559654:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969429.559673:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab0d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6316c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969429.559791:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1783969429.559954:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab0d6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6316c expref: 31 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.559968:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac78c550100) 00010000:00010000:0.0:1783969429.559981:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783969429.559986:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab0d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6316c expref: 31 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.560000:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92400, rc 0) 00000100:00100000:0.0:1783969429.560067:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7aead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+30:10293:x1870627272160896:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 437us (729us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1783969429.560075:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 46 00000100:00100000:1.0:1783969429.562564:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969429.562643:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272161024 00000100:00100000:3.0:1783969429.562652:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272161024 00000100:00100000:3.0:1783969429.562903:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 47 00000100:00100000:3.0:1783969429.562915:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+30:10293:x1870627272161024:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:3.0:1783969429.562981:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab0e4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.562997:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab0e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563022:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab0e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563037:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab0eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563044:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab0eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563051:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab0eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563155:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab0f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563163:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab0f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563171:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab0f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783969429.563208:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab0f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563220:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab0e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563226:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab0e4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563233:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab0e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563240:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969429.563244:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab0e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563251:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab0e4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563261:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:3.0:1783969429.563265:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969429.563268:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab0e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563280:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab0e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563293:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab0eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563300:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab0eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563306:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab0eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563324:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969429.563327:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab0eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563333:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab0eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563342:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ac78c550f00) 00010000:00010000:3.0:1783969429.563345:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969429.563348:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab0eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563354:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab0eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563367:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab0f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563373:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab0f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563384:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab0f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563390:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969429.563393:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab0f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563398:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab0f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563405:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086600) 00010000:00010000:3.0:1783969429.563407:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969429.563410:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab0f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969429.563415:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab0f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969429.563472:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+30:10293:x1870627272161024:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 560us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969429.563480:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 47 00000100:00100000:2.0:1783969429.565616:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969429.565692:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272161280 00000100:00100000:0.0:1783969429.565701:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272161280 00000100:00100000:0.0:1783969429.565762:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:0.0:1783969429.565772:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+30:10293:x1870627272161280:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1783969429.566049:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+31:10293:x1870627272161280:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 278us (442us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1783969429.566057:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:2.0:1783969429.629452:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969429.629614:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272161536 00000100:00100000:1.0:1783969429.629624:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272161536 00000100:00100000:1.0:1783969429.629685:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 48 00000100:00100000:1.0:1783969429.629696:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+31:10296:x1870627272161536:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1783969429.629733:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969429.629756:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab0f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63173 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.629831:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab100 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.629846:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab100 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969429.630079:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab100 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.630283:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab107 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.630293:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab107 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.630302:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab107 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.630413:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab10e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.630422:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab10e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.630429:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab10e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969429.630440:0:6618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783969429.630646:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab100 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.630654:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab100 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.630660:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab100 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.630678:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60ee00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969429.630682:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab100 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.630689:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab100 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.630700:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:2.0:1783969429.630703:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969429.630707:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab100 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.630713:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab100 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.630727:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab107 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.630732:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab107 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.630738:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab107 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.630743:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2044a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969429.630745:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab107 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.630750:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab107 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.630767:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ac785336600) 00010000:00010000:2.0:1783969429.630770:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969429.630772:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab107 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.630778:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab107 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.630818:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab0f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63173 expref: 34 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.630831:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab10e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63173 expref: 33 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969429.630838:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086600) 00010000:00010000:2.0:1783969429.630841:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783969429.630843:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c2044c00, rc 0) 00000100:00100000:2.0:1783969429.630983:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+33:10296:x1870627272161536:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1288us (1540us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1783969429.630991:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 48 00000100:00100000:3.0:1783969429.637572:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969429.642125:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272161664 00000100:00100000:0.0:1783969429.642139:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272161664 00000100:00100000:0.0:1783969429.642554:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 49 00000100:00100000:0.0:1783969429.642567:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+33:10296:x1870627272161664:12345-192.168.203.39@tcp:54:lfs.0 00010000:00010000:0.0:1783969429.642646:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab11c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.642662:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab11c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.642674:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab11c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.642717:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab11c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.642724:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab11c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.642730:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab11c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.642735:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969429.642740:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab11c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.642747:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab11c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.642757:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086600) 00010000:00010000:0.0:1783969429.642761:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783969429.642764:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab11c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969429.642771:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab11c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969429.642838:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+33:10296:x1870627272161664:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 274us (5275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969429.642845:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 49 00000100:00100000:2.0:1783969429.645781:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969429.645896:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272161920 00000100:00100000:1.0:1783969429.645904:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272161920 00000100:00100000:1.0:1783969429.645948:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:1.0:1783969429.645958:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+33:10296:x1870627272161920:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1783969429.646685:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+34:10296:x1870627272161920:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 726us (909us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1783969429.646693:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:1.0:1783969430.033575:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969430.033735:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272162176 00000100:00100000:0.0:1783969430.033746:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272162176 00000100:00100000:0.0:1783969430.033822:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 50 00000100:00100000:0.0:1783969430.033843:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+34:10327:x1870627272162176:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:0.0:1783969430.033891:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969430.033913:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab123 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6317a expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.034018:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab12a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.034033:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab12a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.034046:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab12a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969430.034067:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783969430.034205:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab123 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6317a expref: 37 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.034224:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab12a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6317a expref: 36 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.034232:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086600) 00010000:00010000:0.0:1783969430.034235:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969430.034238:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92e00, rc 0) 00000100:00100000:0.0:1783969430.034298:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+36:10327:x1870627272162176:12345-192.168.203.39@tcp:101:cat.0 Request processed in 457us (732us total) trans 4294967331 rc 0/0 00000100:00080000:2.0:1783969430.034395:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969430.034898:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 50 00000100:00100000:3.0:1783969430.041320:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969430.041369:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969430.041457:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272162432 00000100:00100000:2.0:1783969430.041467:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272162432 00000100:00100000:2.0:1783969430.041528:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00100000:2.0:1783969430.041538:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+36:10327:x1870627272162432:12345-192.168.203.39@tcp:35:cat.0 00000100:00100000:2.0:1783969430.041788:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+37:10327:x1870627272162432:12345-192.168.203.39@tcp:35:cat.0 Request processed in 251us (487us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1783969430.041811:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00100000:1.0:1783969430.041959:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272162560 00000100:00100000:1.0:1783969430.041963:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272162560 00000100:00100000:1.0:1783969430.042012:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3 00000100:00100000:1.0:1783969430.042026:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a61850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+37:2351:x1870627272162560:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969430.042036:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969430.042066:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab12a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6317a expref: 37 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969430.042081:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086600) 00010000:00010000:1.0:1783969430.042085:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969430.042106:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a61850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+36:2351:x1870627272162560:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 81us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969430.042112:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3 00010000:00010000:1.0:1783969430.054284:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969430.132642:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969430.132748:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272162816 00000100:00100000:2.0:1783969430.132757:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272162816 00000100:00100000:2.0:1783969430.132820:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 51 00000100:00100000:2.0:1783969430.132832:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+36:10333:x1870627272162816:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1783969430.132882:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969430.132886:0:6618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783969430.132911:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab090 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63150 expref: 36 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.132929:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:2.0:1783969430.132934:0:6618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783969430.132948:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab138 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63181 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.133052:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab13f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.133415:0:6618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab10e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63173 expref: 36 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.133424:0:6618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab13f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.133457:0:6618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab10e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63173 expref: 36 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.133471:0:6618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab10e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63173 expref: 36 pid: 6618 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969430.133499:0:6618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac682511c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6618:1870627280580224:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783969430.133641:0:6618:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac786283900 going to sleep for 11 seconds 00000100:00100000:3.0:1783969430.138021:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969430.138222:0:8304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272162944 00000100:00100000:1.0:1783969430.138231:0:8304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272162944 00010000:00010000:1.0:1783969430.138271:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab10e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63173 expref: 37 pid: 6618 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969430.138323:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 38 00000100:00100000:1.0:1783969430.138334:0:8304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+37:2350:x1870627272162944:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969430.138349:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969430.138356:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab10e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63173 expref: 37 pid: 6618 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969430.138369:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab10e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63173 expref: 37 pid: 6618 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969430.138390:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086600) 00010000:00010000:1.0:1783969430.138410:0:8304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab13f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969430.138431:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab13f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969430.138438:0:8304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab13f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969430.138458:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969430.138514:0:8304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+37:2350:x1870627272162944:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 182us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969430.138520:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 38 00010000:00010000:2.0:1783969430.138989:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab10e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63173 expref: 36 pid: 6618 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969430.139021:0:6618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac682511c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6618:1870627280580224:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969430.139040:0:6618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab13f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.139049:0:6618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab13f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.139064:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab13f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969430.139082:0:6618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783969430.139236:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab138 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63181 expref: 37 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.139251:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab13f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63181 expref: 36 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.139258:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086600) 00010000:00010000:2.0:1783969430.139261:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783969430.139264:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c2045200, rc 0) 00000100:00100000:2.0:1783969430.139296:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+36:10333:x1870627272162816:12345-192.168.203.39@tcp:101:dd.0 Request processed in 6466us (6665us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1783969430.139326:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 51 00000100:00100000:3.0:1783969430.141497:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969430.141582:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272163200 00000100:00100000:0.0:1783969430.141591:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272163200 00000100:00100000:0.0:1783969430.141656:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 52 00000100:00100000:0.0:1783969430.141666:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+36:10333:x1870627272163200:12345-192.168.203.39@tcp:36:dd.0 00010000:00010000:0.0:1783969430.141951:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab14d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.141968:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab14d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.141978:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab14d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783969430.142041:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1783969430.142215:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e069e33a reply state 0000000052b895df transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab14d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969430.142225:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783969430.142316:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+39:10333:x1870627272163200:12345-192.168.203.39@tcp:36:dd.0 Request processed in 651us (826us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1783969430.142323:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 52 00000020:00080000:0.0:1783969430.142328:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783969430.143673:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab14d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.143685:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab14d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.143693:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab14d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.143698:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969430.143703:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab14d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.143710:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab14d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.143725:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086600) 00010000:00010000:2.0:1783969430.143728:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969430.143732:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab14d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.143738:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab14d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969430.543642:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969430.543735:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272163328 00000100:00100000:0.0:1783969430.543745:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272163328 00000100:00100000:0.0:1783969430.543813:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 53 00000100:00100000:0.0:1783969430.543823:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+38:10347:x1870627272163328:12345-192.168.203.39@tcp:101:stat.0 00010000:00010000:0.0:1783969430.543846:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969430.543893:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab154 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63188 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.543956:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab15b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.543994:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab15b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.544016:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab15b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.544030:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab162 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.544037:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab162 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.544043:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab162 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.544138:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab169 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.544148:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab13f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63181 expref: 39 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.544156:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab169 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.544189:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab13f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63181 expref: 39 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.544204:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab13f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63181 expref: 39 pid: 6618 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969430.544401:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a76c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1870627280580352:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783969430.544497:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa45600 going to sleep for 11 seconds 00000100:00100000:0.0:1783969430.547457:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a76c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1870627280580352:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783969430.547488:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab169 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969430.547697:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969430.547981:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272163584 00000100:00100000:2.0:1783969430.547989:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272163584 00000100:00100000:2.0:1783969430.548053:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:2.0:1783969430.548063:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+40:5578:x1870627272163584:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783969430.549686:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+41:5578:x1870627272163584:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 1615us (1981us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1783969430.549709:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:3.0:1783969430.552353:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969430.552547:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272163712 00000100:00100000:1.0:1783969430.552556:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272163712 00010000:00010000:1.0:1783969430.552729:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab13f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63181 expref: 41 pid: 6618 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969430.552773:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 39 00000100:00100000:1.0:1783969430.552784:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+41:2350:x1870627272163712:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969430.552808:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969430.552815:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab13f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63181 expref: 41 pid: 6618 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969430.552829:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab13f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63181 expref: 41 pid: 6618 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969430.553821:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab13f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63181 expref: 41 pid: 6618 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969430.553846:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086600) 00010000:00010000:1.0:1783969430.553853:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab169 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969430.553907:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab169 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969430.553915:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab169 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969430.554077:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969430.554141:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+40:2350:x1870627272163712:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1359us (1796us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969430.554150:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 39 00010000:00010000:0.0:1783969430.554672:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab169 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.554682:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab169 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969430.554729:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1783969430.554734:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783969430.554775:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab169 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.554788:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab169 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.554797:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab15b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.554804:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab15b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.554811:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab15b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.554902:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969430.554920:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab15b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.554928:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab15b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.554940:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:0.0:1783969430.554943:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969430.554947:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab15b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.554954:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab15b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.554966:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab162 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.554973:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab162 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.554979:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab162 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.554984:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969430.554987:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab162 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.555116:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab162 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.555126:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ac790086300) 00010000:00010000:0.0:1783969430.555128:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969430.555138:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab162 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.555201:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab162 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.555244:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab154 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63188 expref: 40 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.555258:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab169 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63188 expref: 39 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.555266:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086600) 00010000:00010000:0.0:1783969430.555268:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969430.555271:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93800, rc 0) 00000100:00100000:0.0:1783969430.555389:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+39:10347:x1870627272163328:12345-192.168.203.39@tcp:101:stat.0 Request processed in 11506us (11695us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969430.555397:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 53 00000100:00100000:3.0:1783969430.623479:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969430.623968:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272163968 00000100:00100000:2.0:1783969430.623979:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272163968 00000100:00100000:2.0:1783969430.624055:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 54 00000100:00100000:2.0:1783969430.624065:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+39:10353:x1870627272163968:12345-192.168.203.39@tcp:36:truncate.0 00010000:00010000:2.0:1783969430.624125:0:6618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969430.624151:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab169 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63188 expref: 39 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.624172:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086600) 00010000:00010000:2.0:1783969430.624178:0:6618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783969430.624388:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab170 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.624402:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab170 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.624411:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab170 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783969430.624459:0:6618:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1783969430.624483:0:6618:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005ae87d5f reply state 0000000001647a03 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab170 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969430.624493:0:6618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783969430.624611:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+41:10353:x1870627272163968:12345-192.168.203.39@tcp:36:truncate.0 Request processed in 545us (1140us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1783969430.624618:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 54 00000020:00080000:2.0:1783969430.624634:0:6618:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783969430.627984:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab170 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.628011:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab170 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.628026:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab170 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.628031:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2044a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969430.628035:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab170 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.628042:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab170 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.628057:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086600) 00010000:00010000:2.0:1783969430.628060:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969430.628064:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab170 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.628070:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab170 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969430.776610:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969430.776820:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272164096 00000100:00100000:0.0:1783969430.776830:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272164096 00000100:00100000:0.0:1783969430.776916:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 55 00000100:00100000:0.0:1783969430.776926:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+40:10367:x1870627272164096:12345-192.168.203.39@tcp:101:stat.0 00010000:00010000:0.0:1783969430.776950:0:10288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969430.776972:0:10288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab177 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6318f expref: -99 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777043:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab17e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777069:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab17e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777082:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab17e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777097:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab185 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777104:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab185 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777110:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab185 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777206:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab18c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777215:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab18c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777223:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab18c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969430.777258:0:10288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1783969430.777263:0:10288:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783969430.777282:0:10288:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab18c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777293:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab18c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777313:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab17e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777318:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab17e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777325:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab17e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777331:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969430.777335:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab17e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777342:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab17e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777353:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:0.0:1783969430.777356:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969430.777360:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab17e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777366:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab17e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777379:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab185 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777385:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab185 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777391:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab185 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777402:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969430.777405:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab185 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777411:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab185 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777420:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ac790086300) 00010000:00010000:0.0:1783969430.777422:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969430.777425:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab185 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777432:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab185 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777462:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab177 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6318f expref: 42 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777475:0:10288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab18c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6318f expref: 41 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.777483:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086600) 00010000:00010000:0.0:1783969430.777485:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969430.777488:0:10288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93e00, rc 0) 00000100:00100000:0.0:1783969430.777558:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+41:10367:x1870627272164096:12345-192.168.203.39@tcp:101:stat.0 Request processed in 633us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969430.777566:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 55 00000100:00100000:1.0:1783969430.875219:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969430.875342:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272164352 00000100:00100000:0.0:1783969430.875366:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272164352 00000100:00100000:0.0:1783969430.875431:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 56 00000100:00100000:0.0:1783969430.875441:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+41:10377:x1870627272164352:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783969430.875459:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969430.875479:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab193 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63196 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969430.875592:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1783969430.875730:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab193 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63196 expref: 43 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.875933:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac78c550100) 00010000:00010000:0.0:1783969430.875937:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783969430.875943:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab193 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63196 expref: 43 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.875957:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93000, rc 0) 00000100:00100000:0.0:1783969430.876060:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+42:10377:x1870627272164352:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 620us (860us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1783969430.876068:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 56 00000100:00100000:3.0:1783969430.879629:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969430.879689:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272164608 00000100:00100000:0.0:1783969430.879698:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272164608 00000100:00100000:0.0:1783969430.879770:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 14 00000100:00100000:0.0:1783969430.879781:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+42:10377:x1870627272164608:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1783969430.880073:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+43:10377:x1870627272164608:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 293us (451us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1783969430.880082:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 14 00000100:00100000:3.0:1783969430.951979:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969430.952102:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272164864 00000100:00100000:2.0:1783969430.952112:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272164864 00000100:00100000:2.0:1783969430.952168:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 57 00000100:00100000:2.0:1783969430.952176:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+43:10383:x1870627272164864:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:2.0:1783969430.952199:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969430.952228:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab1a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6319d expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.952561:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab1a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.952576:0:6618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab18c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6318f expref: 44 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.952586:0:6618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab1a8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.952616:0:6618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab18c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6318f expref: 44 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.952629:0:6618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab18c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6318f expref: 44 pid: 10288 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969430.952641:0:6618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac682511c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6618:1870627280580480:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783969430.952727:0:6618:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac786283000 going to sleep for 11 seconds 00000100:00100000:1.0:1783969430.955919:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969430.956140:0:6618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac682511c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6618:1870627280580480:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969430.956165:0:6618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab1a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969430.956265:0:8304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272164992 00000100:00100000:3.0:1783969430.956270:0:8304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272164992 00010000:00010000:3.0:1783969430.956297:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab18c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6318f expref: 45 pid: 10288 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969430.956427:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 40 00000100:00100000:3.0:1783969430.956625:0:8304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+45:2350:x1870627272164992:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969430.956640:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969430.956647:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab18c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6318f expref: 45 pid: 10288 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969430.956660:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab18c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6318f expref: 45 pid: 10288 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969430.956679:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab18c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6318f expref: 45 pid: 10288 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969430.956690:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086600) 00010000:00010000:3.0:1783969430.956695:0:8304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab1a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969430.956704:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab1a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969430.956789:0:8304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab1a8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969430.956841:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969430.956927:0:8304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+44:2350:x1870627272164992:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 305us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969430.956934:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 40 00010000:00010000:2.0:1783969430.957102:0:6618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab1a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.957109:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab1a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969430.957125:0:6618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1783969430.957279:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab1a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6319d expref: 45 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.957295:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab1a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6319d expref: 44 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.957302:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086600) 00010000:00010000:2.0:1783969430.957305:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783969430.957307:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c2044c00, rc 0) 00000100:00100000:2.0:1783969430.957344:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+44:10383:x1870627272164864:12345-192.168.203.39@tcp:101:bash.0 Request processed in 5168us (5374us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1783969430.957350:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 57 00000100:00100000:3.0:1783969430.960663:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969430.960811:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272165248 00000100:00100000:2.0:1783969430.960820:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272165248 00000100:00100000:2.0:1783969430.961021:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 58 00000100:00100000:2.0:1783969430.961032:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+44:10383:x1870627272165248:12345-192.168.203.39@tcp:36:bash.0 00010000:00010000:2.0:1783969430.961403:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab1b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.961481:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab1b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.961495:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab1b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783969430.961552:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1783969430.961577:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000093fe2432 reply state 00000000dd05c4a3 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab1b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969430.961586:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783969430.961691:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+47:10383:x1870627272165248:12345-192.168.203.39@tcp:36:bash.0 Request processed in 660us (1035us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1783969430.961698:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 58 00000020:00080000:2.0:1783969430.961703:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783969430.968101:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab1b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.968185:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab1b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.968194:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab1b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.968201:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2045a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969430.968206:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab1b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.968214:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab1b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.968232:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086600) 00010000:00010000:2.0:1783969430.968236:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969430.968241:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab1b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.968248:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab1b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969430.974953:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969430.975036:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272165376 00000100:00100000:0.0:1783969430.975046:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272165376 00000100:00100000:0.0:1783969430.975109:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 59 00000100:00100000:0.0:1783969430.975120:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+46:10383:x1870627272165376:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:0.0:1783969430.975144:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969430.975163:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab1bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb631a4 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.975279:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab1c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.975295:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab1a8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6319d expref: 47 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.975303:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab1c4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.975348:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab1a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6319d expref: 47 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969430.975362:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab1a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6319d expref: 47 pid: 6618 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969430.975376:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a76c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1870627280580608:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783969430.975462:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa450c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969430.978314:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969430.980696:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272165504 00000100:00100000:2.0:1783969430.980710:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272165504 00010000:00010000:2.0:1783969430.980756:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab1a8 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6319d expref: 48 pid: 6618 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969430.980823:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 41 00000100:00100000:2.0:1783969430.980835:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+48:2350:x1870627272165504:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969430.980851:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969430.980901:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab1a8 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6319d expref: 48 pid: 6618 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.980915:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab1a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6319d expref: 48 pid: 6618 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.980937:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086600) 00010000:00010000:2.0:1783969430.980942:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab1c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.980951:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.980958:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab1c4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969430.980977:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969430.981153:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+48:2350:x1870627272165504:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 320us (2847us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969430.981160:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 41 00010000:00010000:1.0:1783969430.985516:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab1a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6319d expref: 47 pid: 6618 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969430.985544:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a76c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1870627280580608:192.168.203.39@tcp:104: 00010000:00010000:1.0:1783969430.985568:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969430.985578:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969430.985601:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969430.985655:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783969430.985660:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783969430.985678:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab1c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969430.985708:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab1bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631a4 expref: 47 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969430.985722:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab1c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631a4 expref: 46 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969430.985732:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086600) 00010000:00010000:1.0:1783969430.985735:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783969430.985738:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92400, rc 0) 00000100:00100000:1.0:1783969430.985809:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+46:10383:x1870627272165376:12345-192.168.203.39@tcp:101:bash.0 Request processed in 10691us (10864us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969430.985817:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 59 00000100:00100000:0.0:1783969430.990690:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969430.990974:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272165760 00000100:00100000:1.0:1783969430.990984:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272165760 00000100:00100000:1.0:1783969430.991053:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00100000:1.0:1783969430.991063:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786070050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+46:10383:x1870627272165760:12345-192.168.203.39@tcp:35:bash.0 00000100:00100000:1.0:1783969430.991320:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786070050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+47:10383:x1870627272165760:12345-192.168.203.39@tcp:35:bash.0 Request processed in 258us (638us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1783969430.991329:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00100000:3.0:1783969431.058506:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969431.060040:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272166016 00000100:00100000:2.0:1783969431.060053:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272166016 00000100:00100000:2.0:1783969431.060132:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 60 00000100:00100000:2.0:1783969431.060142:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+47:10393:x1870627272166016:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783969431.060184:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969431.060205:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab1cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb631ab expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969431.060621:0:6618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1783969431.060748:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab1cb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631ab expref: 49 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.060763:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac78c550100) 00010000:00010000:2.0:1783969431.060766:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783969431.060771:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab1cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631ab expref: 49 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.060791:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c2045a00, rc 0) 00000100:00100000:2.0:1783969431.061131:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+48:10393:x1870627272166016:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 988us (2633us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1783969431.061139:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 60 00000100:00100000:3.0:1783969431.066145:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969431.067889:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272166144 00000100:00100000:2.0:1783969431.067910:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272166144 00000100:00100000:2.0:1783969431.067975:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 61 00000100:00100000:2.0:1783969431.068016:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+48:10393:x1870627272166144:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:2.0:1783969431.068110:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab1d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068127:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab1d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068139:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab1d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068162:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab1e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068170:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068177:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068269:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045800/0xbacf56d076fab1e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068283:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045800/0xbacf56d076fab1e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068290:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045800/0xbacf56d076fab1e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783969431.068501:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045800/0xbacf56d076fab1e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068515:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab1d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068522:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab1d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068529:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab1d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068536:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2045a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969431.068539:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab1d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068554:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab1d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068566:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:2.0:1783969431.068569:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969431.068573:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab1d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068579:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab1d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068590:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068595:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab1e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068601:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab1e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068605:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2044a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969431.068608:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab1e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068614:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab1e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068621:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ac785336600) 00010000:00010000:2.0:1783969431.068623:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969431.068626:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab1e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068640:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab1e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068655:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045800/0xbacf56d076fab1e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068661:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045800/0xbacf56d076fab1e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068667:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045800/0xbacf56d076fab1e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068672:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2045800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969431.068675:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045800/0xbacf56d076fab1e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068680:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045800/0xbacf56d076fab1e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068687:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086600) 00010000:00010000:2.0:1783969431.068689:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969431.068692:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045800/0xbacf56d076fab1e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.068698:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045800/0xbacf56d076fab1e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969431.068783:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+48:10393:x1870627272166144:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 797us (2645us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969431.068790:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 61 00000100:00100000:0.0:1783969431.072570:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969431.072647:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272166400 00000100:00100000:2.0:1783969431.072665:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272166400 00000100:00100000:2.0:1783969431.072720:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:2.0:1783969431.072730:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+48:10393:x1870627272166400:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1783969431.073028:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+49:10393:x1870627272166400:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 299us (466us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1783969431.073036:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 16 00010000:00010000:0.0:1783969431.078520:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969431.131167:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969431.132030:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272166656 00000100:00100000:0.0:1783969431.132041:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272166656 00000100:00100000:0.0:1783969431.132288:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 62 00000100:00100000:0.0:1783969431.132309:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+49:10396:x1870627272166656:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783969431.132437:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969431.132458:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab1ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb631b2 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.132524:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab1f5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.132537:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab1f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.132548:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab1f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.132562:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab1fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.132569:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab1fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.132576:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab1fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.132701:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab203 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.132709:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab203 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.132738:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab203 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969431.132763:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783969431.133068:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab1f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.133077:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab1f5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.133083:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab1f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.133089:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969431.133093:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab1f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.133099:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab1f5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.133111:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:0.0:1783969431.133114:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969431.133130:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab1f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.133137:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab1f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.133149:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab1fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.133155:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab1fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.133167:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab1fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.133172:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969431.133175:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab1fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.133182:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab1fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.133190:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ac790086300) 00010000:00010000:0.0:1783969431.133192:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969431.133195:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab1fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.133200:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab1fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.133243:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab1ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631b2 expref: 52 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.133257:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab203 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631b2 expref: 51 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.133264:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086600) 00010000:00010000:0.0:1783969431.133266:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969431.133268:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93000, rc 0) 00000100:00100000:0.0:1783969431.133680:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+51:10396:x1870627272166656:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1380us (2522us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1783969431.133699:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 62 00000100:00100000:3.0:1783969431.136675:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969431.136807:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272166784 00000100:00100000:0.0:1783969431.136816:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272166784 00000100:00100000:3.0:1783969431.137277:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:3.0:1783969431.137292:0:8304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf740700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+51:2350:x1870627272166784:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969431.137456:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969431.137481:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab203 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631b2 expref: 51 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.137501:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086600) 00010000:00010000:3.0:1783969431.137507:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969431.137675:0:8304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf740700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+50:2350:x1870627272166784:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 388us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969431.137683:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:2.0:1783969431.141030:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783969431.141050:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac682511c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280580736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783969431.141109:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969431.141426:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280580736 00000100:00100000:2.0:1783969431.141445:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280580736 00000100:00100000:2.0:1783969431.141499:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783969431.141507:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280580736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969431.141548:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1783969431.142001:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969431.142044:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682512300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280580736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 537us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969431.142053:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783969431.142098:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac682511c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280580736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969431.148266:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969431.149692:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272166912 00000100:00100000:1.0:1783969431.149704:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272166912 00000100:00100000:1.0:1783969431.149760:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 63 00000100:00100000:1.0:1783969431.150190:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+50:10396:x1870627272166912:12345-192.168.203.39@tcp:54:lfs.0 00010000:00010000:1.0:1783969431.150255:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab211 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.150272:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab211 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.150284:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab211 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.150362:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab211 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.150370:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab211 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.150377:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab211 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.150384:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60ec00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969431.150388:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab211 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.150395:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab211 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.150407:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086600) 00010000:00010000:1.0:1783969431.150418:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783969431.150423:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab211 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.150497:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab211 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969431.150699:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+50:10396:x1870627272166912:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 929us (2496us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969431.150708:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 63 00000100:00100000:1.0:1783969431.164478:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969431.164640:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272167168 00000100:00100000:0.0:1783969431.164650:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272167168 00000100:00100000:0.0:1783969431.164703:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:0.0:1783969431.164714:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+50:10396:x1870627272167168:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1783969431.165258:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+51:10396:x1870627272167168:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 544us (786us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1783969431.165266:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 17 00000001:00080000:1.0:1783969431.221319:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967347 is committed 00000004:00080000:1.0:1783969431.221395:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1783969431.221428:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ac786283c00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1783969431.221432:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ac7860c9500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ac786283540 00000020:00080000:1.0:1783969431.221435:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ac7860c9a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ac7bf6a8800 00000020:00080000:2.0:1783969431.221497:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1783969431.221605:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1783969431.221795:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783969431.221816:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280580864:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783969431.221913:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969431.222030:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280580864 00000100:00100000:0.0:1783969431.222039:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280580864 00000100:00080000:2.0:1783969431.222173:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783969431.222260:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783969431.222273:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682511c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1870627280580864:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783969431.222312:0:6594:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1783969431.222343:0:6594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a553695, atime: 0x6a553695, ctime: 0x6a553695, blocks: 0xb 00010000:00010000:0.0:1783969431.222352:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a983476f/0xbacf56d076fab218 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.222367:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=288s v=(0 0) 00010000:00010000:0.0:1783969431.222372:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969431.222379:0:6594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a983476f/0xbacf56d076fab218 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.222395:0:6594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a983476f/0xbacf56d076fab218 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.222429:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a983476f/0xbacf56d076fab218 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.222437:0:6594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a983476f/0xbacf56d076fab218 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.222493:0:6594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783969431.223040:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682511c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3286:x1870627280580864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 769us (1124us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1783969431.223048:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:1.0:1783969431.223137:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ac7bf742a00/2, rc 0, transno 4294967301 00000100:00100000:1.0:1783969431.223146:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf742a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280580864:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1783969431.225980:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969431.226001:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a983476f/0xbacf56d076fab218 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.226016:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92600 already unused, calling callback (ffffffffc1485230) 00010000:00010000:3.0:1783969431.226036:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a983476f/0xbacf56d076fab218 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.226048:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a983476f/0xbacf56d076fab218 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.226072:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a983476f/0xbacf56d076fab218 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.226080:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a983476f/0xbacf56d076fab218 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.226173:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969431.226175:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969431.226177:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969431.317300:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969431.319646:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272167424 00000100:00100000:0.0:1783969431.319660:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272167424 00000100:00100000:0.0:1783969431.319739:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 64 00000100:00100000:0.0:1783969431.319749:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+12:10414:x1870627272167424:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:0.0:1783969431.319774:0:10288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969431.319795:0:10288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab21f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb631b9 expref: -99 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.319946:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab226 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.319962:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab226 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.319975:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab226 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969431.320015:0:10288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783969431.320144:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab21f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631b9 expref: 15 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.320162:0:10288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab226 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631b9 expref: 14 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.320170:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086600) 00010000:00010000:0.0:1783969431.320173:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783969431.320176:0:10288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92e00, rc 0) 00000100:00100000:0.0:1783969431.320240:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+14:10414:x1870627272167424:12345-192.168.203.39@tcp:101:cat.0 Request processed in 491us (2948us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1783969431.320247:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 64 00000100:00100000:1.0:1783969431.352413:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969431.352550:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272167552 00000100:00100000:0.0:1783969431.352559:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272167552 00000100:00100000:0.0:1783969431.352616:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 65 00000100:00100000:0.0:1783969431.352625:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+14:10415:x1870627272167552:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783969431.352646:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969431.352666:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab234 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb631c0 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.352723:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab23b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.352736:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab23b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.352765:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab23b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969431.353096:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1783969431.353101:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783969431.353174:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab23b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.353202:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab234 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631c0 expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.353220:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab23b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631c0 expref: 15 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.353229:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:0.0:1783969431.353231:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783969431.353235:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93800, rc 0) 00000100:00100000:0.0:1783969431.353297:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+15:10415:x1870627272167552:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 672us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969431.353305:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 65 00000100:00100000:1.0:1783969431.369909:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969431.370091:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272167936 00000100:00100000:0.0:1783969431.370100:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272167936 00000100:00100000:0.0:1783969431.370156:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:0.0:1783969431.370165:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+15:10415:x1870627272167936:12345-192.168.203.39@tcp:35:lfs.0 00000001:00080000:0.0:1783969431.370438:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967350 00000100:00100000:0.0:1783969431.370539:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+17:10415:x1870627272167936:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 374us (639us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1783969431.370562:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 18 00000020:00080000:0.0:1783969431.370567:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783969431.372917:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969431.373066:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272168064 00000100:00100000:2.0:1783969431.373076:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272168064 00000100:00100000:2.0:1783969431.373133:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:2.0:1783969431.373144:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf743480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+17:10415:x1870627272168064:12345-192.168.203.39@tcp:103:lfs.0 00010000:00010000:2.0:1783969431.373158:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783969431.373182:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab1c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631a4 expref: 17 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.373201:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab226 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631b9 expref: 16 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.373212:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab0cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63165 expref: 15 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.373222:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086600) 00010000:00010000:2.0:1783969431.373232:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969431.373288:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf743480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+14:10415:x1870627272168064:12345-192.168.203.39@tcp:103:lfs.0 Request processed in 146us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969431.373295:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:1.0:1783969431.375719:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969431.375834:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272168192 00000100:00100000:2.0:1783969431.375842:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272168192 00000100:00100000:2.0:1783969431.375926:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 66 00000100:00100000:2.0:1783969431.375935:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+14:10415:x1870627272168192:12345-192.168.203.39@tcp:58:lfs.0 00010000:00010000:2.0:1783969431.376063:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045800/0xbacf56d076fab242 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.376080:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045800/0xbacf56d076fab242 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.376102:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045800/0xbacf56d076fab242 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783969431.376716:0:6618:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783969431.376917:0:6618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1783969431.376973:0:6618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1783969431.377076:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+14:10415:x1870627272168192:12345-192.168.203.39@tcp:58:lfs.0 Request processed in 1141us (1375us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969431.377085:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 66 00000100:00100000:1.0:1783969431.407767:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969431.407884:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272168320 00000100:00100000:0.0:1783969431.407893:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272168320 00000100:00100000:0.0:1783969431.407944:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 67 00000100:00100000:0.0:1783969431.407952:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+14:10417:x1870627272168320:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783969431.407971:0:10288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969431.407989:0:10288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab249 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb631c7 expref: -99 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408058:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab250 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408071:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab250 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408082:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab250 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408096:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab257 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408102:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408107:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408398:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab25e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408420:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab25e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408428:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab25e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969431.408462:0:10288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1783969431.408466:0:10288:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783969431.408483:0:10288:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab25e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408494:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab25e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408502:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab250 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408507:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab250 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408513:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab250 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408518:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969431.408522:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab250 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408529:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab250 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408539:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:0.0:1783969431.408548:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969431.408552:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab250 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408559:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab250 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408583:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab257 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408589:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab257 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408594:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab257 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408599:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969431.408602:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab257 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408608:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab257 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408615:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ac790086a00) 00010000:00010000:0.0:1783969431.408618:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969431.408621:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab257 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408626:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab257 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408656:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab249 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631c7 expref: 16 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408681:0:10288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab25e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631c7 expref: 15 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.408687:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac785336400) 00010000:00010000:0.0:1783969431.408690:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783969431.408692:0:10288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92400, rc 0) 00000100:00100000:0.0:1783969431.408759:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+15:10417:x1870627272168320:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 807us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969431.408767:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 67 00000040:00080000:0.0:1783969431.525742:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783969431.525751:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783969431.525886:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1783969431.525895:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783969431.526024:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a76c0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1870627280580992:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783969431.526181:0:11535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa45300 going to sleep for 11 seconds 00000100:00100000:0.0:1783969431.540069:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a76c0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1870627280580992:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783969431.546077:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969431.546666:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272168448 00000100:00100000:0.0:1783969431.546675:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272168448 00000100:00100000:0.0:1783969431.546736:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1 00000100:00100000:0.0:1783969431.546747:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:03985e57-ffb4-414b-b30c-e72697857d4f+15:10428:x1870627272168448:12345-192.168.203.39@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1783969431.546838:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:03985e57-ffb4-414b-b30c-e72697857d4f+15:10428:x1870627272168448:12345-192.168.203.39@tcp:900:lhsmtool_posix.0 Request processed in 92us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969431.546847:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1 00000100:00100000:3.0:1783969431.551638:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969431.551980:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272168576 00000100:00100000:0.0:1783969431.552012:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272168576 00000100:00100000:0.0:1783969431.552069:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 68 00000100:00100000:0.0:1783969431.552080:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+15:10428:x1870627272168576:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783969431.552112:0:5795:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783969431.552208:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+15:10428:x1870627272168576:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 Request processed in 130us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969431.552216:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 68 00000100:00100000:0.0:1783969431.558471:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969431.559112:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272168704 00000100:00100000:3.0:1783969431.559123:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272168704 00000100:00100000:3.0:1783969431.559187:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 69 00000100:00100000:3.0:1783969431.559197:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+15:10428:x1870627272168704:12345-192.168.203.39@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783969431.559273:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab265 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.559290:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab265 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.559329:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab265 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.559393:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fab26c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.559401:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fab26c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.559407:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fab26c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.559434:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab273 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.559441:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab273 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.559447:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab273 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969431.559482:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1783969431.559486:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783969431.559497:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab273 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.559508:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab265 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.559514:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab265 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.559529:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab265 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.559535:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969431.559539:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab265 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.559546:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab265 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.559558:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac790086e00) 00010000:00010000:3.0:1783969431.559561:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969431.559681:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab265 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.559689:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab265 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.559704:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fab26c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.559709:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fab26c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.559715:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fab26c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.559720:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de7a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969431.559723:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fab26c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.559738:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fab26c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.559746:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9ac78c550f00) 00010000:00010000:3.0:1783969431.559748:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969431.559751:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fab26c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.559756:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fab26c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.559769:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab273 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.559775:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab273 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.559780:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab273 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.560006:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969431.560010:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab273 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.560018:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab273 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.560027:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac785336400) 00010000:00010000:3.0:1783969431.560030:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969431.560033:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab273 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.560048:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab273 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969431.560167:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+15:10428:x1870627272168704:12345-192.168.203.39@tcp:34:lhsmtool_posix.0 Request processed in 969us (1702us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969431.560176:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 69 00000100:00100000:0.0:1783969431.568363:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969431.568442:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272168960 00000100:00100000:3.0:1783969431.568451:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272168960 00000100:00100000:3.0:1783969431.568508:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 70 00000100:00100000:3.0:1783969431.568518:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+15:10428:x1870627272168960:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969431.568539:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969431.568559:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab27a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb631ce expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.568666:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab281 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.568682:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab281 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.568693:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab281 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969431.568703:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783969431.568813:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab281 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.568821:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab281 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.568844:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab281 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.568850:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de7400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969431.568854:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab281 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.569057:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab281 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.569071:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac785336400) 00010000:00010000:3.0:1783969431.569074:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783969431.569078:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab281 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.569085:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab281 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.569129:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab27a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631ce expref: 17 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.569139:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac790086e00) 00010000:00010000:3.0:1783969431.569141:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783969431.569145:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab27a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631ce expref: 17 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.569154:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de6a00, rc 0) 00000100:00100000:3.0:1783969431.569214:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+16:10428:x1870627272168960:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 697us (860us total) trans 4294967352 rc 301/301 00000100:00100000:3.0:1783969431.569229:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 70 00000100:00100000:3.0:1783969431.590529:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969431.590681:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272169088 00000100:00100000:2.0:1783969431.590691:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272169088 00000100:00100000:2.0:1783969431.590749:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 71 00000100:00100000:2.0:1783969431.590759:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+16:10428:x1870627272169088:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783969431.591055:0:6618:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783969431.591156:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+16:10428:x1870627272169088:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 Request processed in 398us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969431.591164:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 71 00000100:00100000:0.0:1783969431.604514:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969431.604604:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272169344 00000100:00100000:1.0:1783969431.604613:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272169344 00000100:00100000:1.0:1783969431.604673:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 72 00000100:00100000:1.0:1783969431.604695:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+16:10428:x1870627272169344:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783969431.604715:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969431.604727:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783969431.604755:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab23b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631c0 expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.604772:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:1.0:1783969431.604777:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783969431.604791:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f000/0xbacf56d076fab28f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb631d5 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783969431.606303:0:5793:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1783969431.607248:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab296 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.607266:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.607278:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.607355:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f000/0xbacf56d076fab28f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631d5 expref: 18 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.607373:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab296 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631d5 expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.607382:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ac790086a00) 00010000:00010000:0.0:1783969431.607385:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969431.607389:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93000, rc 0) 00000100:00100000:0.0:1783969431.607461:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+17:10428:x1870627272169344:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 2778us (2953us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1783969431.607480:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 72 00000100:00100000:0.0:1783969431.613117:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969431.613491:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272169600 00000100:00100000:1.0:1783969431.613578:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272169600 00000100:00100000:1.0:1783969431.613639:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 73 00000100:00100000:1.0:1783969431.613649:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+17:10428:x1870627272169600:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783969431.613705:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969431.613730:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab296 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631d5 expref: 17 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.613746:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ac790086a00) 00010000:00010000:1.0:1783969431.613757:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783969431.613776:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fab2a4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.613788:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fab2a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.613798:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fab2a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.615808:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab2ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x884c1308 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.615830:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab2ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x884c1308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.615843:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab2ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x884c1308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.616446:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fab2a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.616456:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fab2a4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.616464:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fab2a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.616471:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60ea00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969431.616475:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fab2a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.616483:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fab2a4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.616565:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:0.0:1783969431.616569:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969431.616574:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fab2a4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.616592:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fab2a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.616606:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab2ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x884c1308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.616612:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab2ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x884c1308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.616618:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab2ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x884c1308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.616623:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969431.616626:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab2ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x884c1308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.616632:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab2ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x884c1308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.616640:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x884c1308 (ffff9ac790086600) 00010000:00010000:0.0:1783969431.616642:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969431.616645:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab2ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x884c1308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.616650:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab2ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x884c1308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969431.616818:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+16:10428:x1870627272169600:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 3167us (3706us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783969431.616826:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 73 00000100:00100000:1.0:1783969431.628184:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969431.628220:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272169728 00000100:00100000:3.0:1783969431.628232:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272169728 00000100:00100000:1.0:1783969431.628375:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 74 00000100:00100000:1.0:1783969431.628385:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+16:10428:x1870627272169728:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783969431.628405:0:10288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969431.628427:0:10288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab2b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb631dc expref: -99 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.628462:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab2b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.628474:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab2b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.628485:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab2b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.628658:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab2b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631dc expref: 18 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.628676:0:10288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab2b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631dc expref: 17 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.628685:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ac7829e0e00) 00010000:00010000:1.0:1783969431.628688:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783969431.628691:0:10288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bf60f400, rc 0) 00000100:00100000:1.0:1783969431.628756:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf637100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+17:10428:x1870627272169728:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 372us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969431.628773:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 74 00000100:00100000:1.0:1783969431.635096:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969431.635230:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272169984 00000100:00100000:3.0:1783969431.635240:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272169984 00000100:00100000:3.0:1783969431.635324:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 75 00000100:00100000:3.0:1783969431.635336:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+17:10428:x1870627272169984:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783969431.635460:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab2c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.635477:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.635488:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783969431.636216:0:5793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1783969431.636228:0:5793:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 288718368084ns, next at 289718365946ns, rc = 0 00000004:00010000:1.0:1783969431.636389:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007450afcf reply state 000000005d204093 transno 4294967354 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969431.636400:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783969431.636558:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf635f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+19:10428:x1870627272169984:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 1163us (1408us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1783969431.636566:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 75 00000100:00100000:3.0:1783969431.640182:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:0.0:1783969431.640564:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.640577:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab2c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.640584:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab2c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.640590:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60e200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969431.640595:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab2c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.640602:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab2c0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.640619:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ac7829e0e00) 00010000:00010000:0.0:1783969431.640623:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783969431.640627:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab2c0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.640633:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab2c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969431.640660:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272170112 00000100:00100000:0.0:1783969431.640669:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272170112 00000100:00100000:0.0:1783969431.640763:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 76 00000100:00100000:0.0:1783969431.640772:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+18:10428:x1870627272170112:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783969431.640804:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969431.640823:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab2c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb631e3 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.641073:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab2c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631e3 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.641086:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab2c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631e3 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.641105:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ac7829e0e00) 00010000:00010000:0.0:1783969431.641108:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783969431.641111:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92600, rc 0) 00000100:00100000:0.0:1783969431.641175:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+19:10428:x1870627272170112:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 404us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969431.641182:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 76 00000100:00100000:3.0:1783969431.650374:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969431.650598:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272170240 00000100:00100000:0.0:1783969431.650608:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272170240 00000100:00100000:0.0:1783969431.650658:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 25 00000100:00100000:0.0:1783969431.650666:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2347:x1870627272170240:12345-192.168.203.39@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1783969431.650696:0:6595:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 03985e57-ffb4-414b-b30c-e72697857d4f@192.168.203.39@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:0.0:1783969431.650726:0:6595:0:(genops.c:1406:class_connect()) connect: client 03985e57-ffb4-414b-b30c-e72697857d4f, cookie 0xbacf56d076fab2ce 00002000:00100000:0.0:1783969431.650738:0:6595:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 03985e57-ffb4-414b-b30c-e72697857d4f/ffff9ac7c18d0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783969431.650748:0:6595:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:0.0:1783969431.651125:0:6595:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783969431.651155:0:6595:0:(import.c:65:import_set_state_nolock()) ffff9ac7c18d1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783969431.651225:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+6:2347:x1870627272170240:12345-192.168.203.39@tcp:8:lhsmtool_posix.0 Request processed in 558us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969431.651243:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 25 00000100:00100000:0.0:1783969431.653173:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a76c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280581248:0@lo:400:kworker.0 00000100:00100000:3.0:1783969431.653177:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c18e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1870627280581504:0@lo:400:kworker.0 00000100:00100000:1.0:1783969431.653253:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a76c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280581120:0@lo:400:kworker.0 00000100:00100000:2.0:1783969431.659923:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a76c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1870627280581376:0@lo:400:kworker.0 00000100:00100000:0.0:1783969431.659928:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969431.659972:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969431.660022:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280581248 00000100:00100000:2.0:1783969431.660029:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280581248 00000100:00100000:0.0:1783969431.660029:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280581376 00000100:00100000:0.0:1783969431.660032:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280581376 00000100:00100000:0.0:1783969431.660079:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1783969431.660089:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870627280581376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969431.660144:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870627280581376:12345-0@lo:400:kworker.0 Request processed in 56us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969431.660151:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1783969431.660215:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969431.660476:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280581504 00000100:00100000:2.0:1783969431.660480:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280581504 00000100:00100000:2.0:1783969431.660499:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1783969431.660505:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280581248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969431.660543:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280581248:12345-0@lo:400:kworker.0 Request processed in 38us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969431.660559:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1783969431.660573:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783969431.660579:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1870627280581504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969431.660614:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1870627280581504:12345-0@lo:400:kworker.0 Request processed in 36us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969431.660620:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783969431.660658:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c18e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1870627280581504:0@lo:400:kworker.0 00000100:00100000:1.0:1783969431.660811:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783969431.662017:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969431.664036:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280581120 00000100:00100000:2.0:1783969431.664048:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280581120 00000100:00100000:2.0:1783969431.664094:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1783969431.664103:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:3286:x1870627280581120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969431.664126:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a76c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1870627280581376:0@lo:400:kworker.0 00000100:00100000:0.0:1783969431.664161:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a76c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280581248:0@lo:400:kworker.0 00000100:00100000:2.0:1783969431.664186:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:3286:x1870627280581120:12345-0@lo:400:kworker.0 Request processed in 83us (3375us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969431.664194:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1783969431.664527:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a76c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280581120:0@lo:400:kworker.0 00000100:00100000:2.0:1783969431.675043:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969431.675306:0:9934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272170368 00000100:00100000:2.0:1783969431.675316:0:9934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272170368 00000100:00100000:2.0:1783969431.675401:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 26 00000100:00100000:2.0:1783969431.675416:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682513b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+6:0:x1870627272170368:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1783969431.675582:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1783969431.712434:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 03985e57-ffb4-414b-b30c-e72697857d4f 00000100:00100000:2.0:1783969431.769901:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682513b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+6:0:x1870627272170368:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 Request processed in 94482us (94912us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1783969431.769914:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 26 00000001:00080000:3.0:1783969431.775713:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:0.0:1783969431.789170:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969431.789213:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272170624 00000100:00100000:0.0:1783969431.789221:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272170624 00000100:00100000:0.0:1783969431.789271:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:0.0:1783969431.789280:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+19:10428:x1870627272170624:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783969431.789502:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+20:10428:x1870627272170624:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 222us (337us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1783969431.789510:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:3.0:1783969431.800282:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969431.800410:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272170880 00000100:00100000:2.0:1783969431.800428:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272170880 00000100:00100000:2.0:1783969431.800490:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 77 00000100:00100000:2.0:1783969431.800501:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+20:10428:x1870627272170880:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783969431.800620:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+20:10428:x1870627272170880:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 120us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969431.800627:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 77 00000100:00100000:2.0:1783969431.803328:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969431.803414:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272171008 00000100:00100000:3.0:1783969431.803422:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272171008 00000100:00100000:3.0:1783969431.803517:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 78 00000100:00100000:3.0:1783969431.803528:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+20:10428:x1870627272171008:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969431.803546:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969431.803566:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab2d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb631ea expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.803630:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab2dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.803644:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab2dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.803663:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab2dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969431.803697:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783969431.803714:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab2dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.803738:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab2d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631ea expref: 22 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.803753:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab2dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631ea expref: 21 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.803762:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ac7829e0e00) 00010000:00010000:3.0:1783969431.803765:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783969431.803768:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7400, rc 0) 00000100:00100000:3.0:1783969431.803826:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+21:10428:x1870627272171008:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 300us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969431.803834:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 78 00000100:00100000:3.0:1783969431.815218:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969431.817099:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272171136 00000100:00100000:1.0:1783969431.817110:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272171136 00000100:00100000:0.0:1783969431.818340:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 27 00000100:00100000:0.0:1783969431.818353:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+5:2348:x1870627272171136:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783969431.818370:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969431.818401:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fab2e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb631f1 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783969431.818429:0:6593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a553697, blocks: 0x1 00010000:00010000:0.0:1783969431.818446:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=288s v=(0 0) 00010000:00010000:0.0:1783969431.818451:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969431.818460:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fab2e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631f1 expref: 6 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.818479:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fab2e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631f1 expref: 6 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.818491:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92e00, rc 0) 00000100:00100000:0.0:1783969431.818555:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+6:2348:x1870627272171136:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 205us (3346us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969431.818562:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 27 00000100:00100000:2.0:1783969431.821070:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969431.821164:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272171392 00000100:00100000:3.0:1783969431.821173:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272171392 00000100:00100000:3.0:1783969431.821228:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 79 00000100:00100000:3.0:1783969431.821237:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+21:10428:x1870627272171392:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783969431.821334:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+21:10428:x1870627272171392:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 98us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969431.821341:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 79 00000100:00100000:2.0:1783969431.834637:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969431.835159:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272171520 00000100:00100000:1.0:1783969431.835170:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272171520 00000100:00100000:1.0:1783969431.835229:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 28 00000100:00100000:1.0:1783969431.835239:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+6:10428:x1870627272171520:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783969431.835256:0:6594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969431.835274:0:6594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c77b7753/0xbacf56d076fab2ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb631f8 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.835401:0:6594:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fab2e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631f1 expref: 7 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.835411:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969431.835416:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969431.835421:0:6594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c77b7753/0xbacf56d076fab2ea lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631f8 expref: 7 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.835455:0:6594:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fab2e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631f1 expref: 7 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.835468:0:6594:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fab2e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631f1 expref: 7 pid: 6593 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969431.835481:0:6594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf635c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6594:1870627280581632:192.168.203.39@tcp:104: 00000100:00100000:1.0:1783969431.835593:0:6594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7c18e2600 going to sleep for 11 seconds 00000100:00100000:2.0:1783969431.856111:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969431.856196:0:6594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf635c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6594:1870627280581632:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783969431.856229:0:6594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c77b7753/0xbacf56d076fab2ea lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631f8 expref: 7 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969431.856251:0:6594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bf60fe00, rc 0) 00000100:00100000:3.0:1783969431.856368:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682510e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+7:10428:x1870627272171520:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 21129us (21739us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969431.856377:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 28 00000100:00100000:0.0:1783969431.857233:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272171648 00000100:00100000:0.0:1783969431.857242:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272171648 00010000:00010000:0.0:1783969431.857279:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fab2e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631f1 expref: 7 pid: 6593 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969431.858075:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 42 00000100:00100000:2.0:1783969431.858091:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a60450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03985e57-ffb4-414b-b30c-e72697857d4f+7:2351:x1870627272171648:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969431.858108:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969431.858133:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fab2e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631f1 expref: 7 pid: 6593 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.858149:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fab2e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631f1 expref: 7 pid: 6593 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.858172:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fab2e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631f1 expref: 7 pid: 6593 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.858187:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969431.858191:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969431.858200:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c77b7753/0xbacf56d076fab2ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631f8 expref: 6 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.858230:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c77b7753/0xbacf56d076fab2ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631f8 expref: 6 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969431.858281:0:5780:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c77b7753/0xbacf56d076fab2ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631f8 expref: 6 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969431.858304:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5780:1870627280581760:192.168.203.39@tcp:105: 00000100:00100000:2.0:1783969431.858381:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7c1579180 going to sleep for 11 seconds 00000100:00100000:0.0:1783969431.867983:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969431.868069:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272171776 00000100:00100000:3.0:1783969431.868078:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272171776 00002000:00100000:3.0:1783969431.868124:0:6600:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9ac7c18e4700 x1870627272171776/t0(0) o4->03985e57-ffb4-414b-b30c-e72697857d4f@192.168.203.39@tcp:327/0 lens 504/0 e 0 to 0 dl 1783969442 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783969431.868135:0:6600:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac7c18e4700 with x1870627272171776 ext(0->8) 00002000:00010000:3.0:1783969431.868140:0:6600:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ac7c18e4700 00000100:00100000:3.0:1783969431.868171:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:3.0:1783969431.868180:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:03985e57-ffb4-414b-b30c-e72697857d4f+7:2350:x1870627272171776:12345-192.168.203.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783969431.868942:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5780:1870627280581760:192.168.203.39@tcp:105: 00010000:00010000:2.0:1783969431.868962:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969431.868998:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a60450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03985e57-ffb4-414b-b30c-e72697857d4f+9:2351:x1870627272171648:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 10903us (12885us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969431.869007:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 42 00000100:00100000:3.0:1783969431.870625:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:03985e57-ffb4-414b-b30c-e72697857d4f+8:2350:x1870627272171776:12345-192.168.203.39@tcp:4:lhsmtool_posix.0 Request processed in 2437us (2641us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1783969431.870638:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 0 00002000:00100000:3.0:1783969431.870650:0:6600:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9ac7c18e4700 x1870627272171776/t4294967302(0) o4->03985e57-ffb4-414b-b30c-e72697857d4f@192.168.203.39@tcp:327/0 lens 504/448 e 0 to 0 dl 1783969442 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783969431.870661:0:6600:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac7c18e4700 with x1870627272171776 ext(0->8) 00002000:00010000:3.0:1783969431.870666:0:6600:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ac7c18e4700 00000100:00100000:0.0:1783969431.876706:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969431.877083:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272171904 00000100:00100000:3.0:1783969431.877102:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272171904 00000100:00100000:3.0:1783969431.877162:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 80 00000100:00100000:3.0:1783969431.877172:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+21:10428:x1870627272171904:12345-192.168.203.39@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783969431.941091:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00000004:00080000:1.0:1783969431.941220:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:2.0:1783969431.941648:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280581888:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783969431.941711:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1783969431.942062:0:11828:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1783969431.942081:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1783969431.942091:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1783969431.942202:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280581888 00000100:00100000:3.0:1783969431.942210:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280581888 00000100:00100000:3.0:1783969431.942263:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783969431.942272:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280581888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1783969431.942434:0:6593:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1783969431.942438:0:6593:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783969431 00002000:00010000:3.0:1783969431.942440:0:6593:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783969431.942442:0:6593:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1783969431 -> 1783969431 00002000:00010000:3.0:1783969431.942444:0:6593:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1783969431.942487:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1870627280581888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 216us (776us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1783969431.942495:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1783969431.942650:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ac7a7961f80/2, rc 0, transno 4294967303 00000100:00100000:2.0:1783969431.942656:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7961f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280581888:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1783969431.943155:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+13:10428:x1870627272171904:12345-192.168.203.39@tcp:44:lhsmtool_posix.0 Request processed in 65982us (66456us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969431.943165:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 80 00000100:00100000:2.0:1783969431.950764:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969431.950948:0:9934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272172032 00000100:00100000:1.0:1783969431.950958:0:9934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272172032 00000100:00100000:1.0:1783969431.951032:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 30 00000100:00100000:1.0:1783969431.951042:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+8:2349:x1870627272172032:12345-192.168.203.39@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1783969431.979683:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:3.0:1783969431.979698:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1783969431.982641:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+6:2349:x1870627272172032:12345-192.168.203.39@tcp:16:lhsmtool_posix.0 Request processed in 31594us (31878us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969431.982653:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 30 00000100:00100000:2.0:1783969431.985946:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969431.986144:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272172288 00000100:00100000:1.0:1783969431.986153:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272172288 00000100:00100000:1.0:1783969431.986210:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 81 00000100:00100000:1.0:1783969431.986219:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+13:10428:x1870627272172288:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783969431.986265:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969431.986292:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab2dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631ea expref: 13 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.986318:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ac7829e0e00) 00010000:00010000:1.0:1783969431.986323:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783969431.986351:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab2f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.986364:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab2f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969431.986373:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab2f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783969431.986616:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cdf134ed reply state 00000000cc22ff14 transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab2f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969431.986625:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783969431.986727:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+14:10428:x1870627272172288:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 507us (789us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1783969431.986734:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 81 00010000:00010000:0.0:1783969431.992454:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab2f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.992481:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab2f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.992489:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab2f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.992495:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60f600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969431.992500:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab2f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.992507:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab2f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.992525:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ac7829e0e00) 00010000:00010000:0.0:1783969431.992528:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969431.992533:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab2f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969431.992539:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab2f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969431.992821:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969431.998666:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272172416 00000100:00100000:3.0:1783969431.998680:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272172416 00000100:00100000:3.0:1783969431.998746:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 31 00000100:00100000:3.0:1783969431.998756:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+6:2350:x1870627272172416:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783969431.999047:0:6593:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1783969431.999051:0:6593:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1783969431 -> 1783969431 00002000:00010000:3.0:1783969431.999053:0:6593:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783969429 00002000:00010000:3.0:1783969431.999056:0:6593:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1783969431 -> 1783969431 00002000:00010000:3.0:1783969431.999058:0:6593:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1783969431.999123:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+7:2350:x1870627272172416:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 Request processed in 368us (6305us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1783969431.999142:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 31 00000100:00100000:1.0:1783969432.001754:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969432.001893:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272172672 00000100:00100000:3.0:1783969432.001901:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272172672 00000100:00100000:3.0:1783969432.001955:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 82 00000100:00100000:3.0:1783969432.001964:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+13:10428:x1870627272172672:12345-192.168.203.39@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783969432.002037:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab2f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.002054:0:6618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab2b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631dc expref: 13 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.002063:0:6618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab2f8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.002096:0:6618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab2b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631dc expref: 13 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.002110:0:6618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab2b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631dc expref: 13 pid: 10288 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969432.002124:0:6618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7960e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6618:1870627280582016:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783969432.002204:0:6618:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bf74c840 going to sleep for 11 seconds 00000100:00080000:1.0:1783969432.002262:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969432.005289:0:6618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7960e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6618:1870627280582016:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783969432.005330:0:6618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab2f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969432.005478:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969432.005537:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272172800 00000100:00100000:2.0:1783969432.005554:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272172800 00010000:00010000:2.0:1783969432.005586:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab2b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631dc expref: 14 pid: 10288 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969432.005627:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 43 00000100:00100000:2.0:1783969432.005636:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+14:2350:x1870627272172800:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969432.005649:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969432.005655:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab2b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631dc expref: 14 pid: 10288 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.005667:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab2b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631dc expref: 14 pid: 10288 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.005686:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab2b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631dc expref: 14 pid: 10288 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.005700:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ac7829e0e00) 00010000:00010000:2.0:1783969432.005705:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab2f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.005724:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab2f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.005732:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab2f8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.005759:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969432.005811:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+13:2350:x1870627272172800:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 175us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969432.005828:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 43 00010000:00010000:1.0:1783969432.006026:0:6618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab2f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.006034:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab2f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.006061:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab2f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.006067:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab2f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.006074:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab2f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.006078:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969432.006082:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab2f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.006088:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab2f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.006097:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ac7829e0e00) 00010000:00010000:1.0:1783969432.006100:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783969432.006103:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab2f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.006118:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab2f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969432.006168:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf635c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+12:10428:x1870627272172672:12345-192.168.203.39@tcp:55:lhsmtool_posix.0 Request processed in 4205us (4422us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783969432.006176:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 82 00000100:00100000:1.0:1783969432.013573:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969432.013640:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272172928 00000100:00100000:3.0:1783969432.013660:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272172928 00000100:00100000:3.0:1783969432.013716:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 32 00000100:00100000:3.0:1783969432.013726:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+7:2350:x1870627272172928:12345-192.168.203.39@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783969432.013767:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000035509dad/0xbacf56d076fab2ff lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.013799:0:6594:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c77b7753/0xbacf56d076fab2ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631f8 expref: 7 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.013809:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1783969432.013813:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783969432.013817:0:6594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035509dad/0xbacf56d076fab2ff lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.013851:0:6594:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c77b7753/0xbacf56d076fab2ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631f8 expref: 7 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.013892:0:6594:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c77b7753/0xbacf56d076fab2ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631f8 expref: 7 pid: 6594 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969432.013907:0:6594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7960e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6594:1870627280582144:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783969432.013979:0:6594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bf74c840 going to sleep for 11 seconds 00000100:00100000:2.0:1783969432.020734:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969432.020813:0:8304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272173056 00000100:00100000:1.0:1783969432.020822:0:8304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272173056 00010000:00010000:1.0:1783969432.020893:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c77b7753/0xbacf56d076fab2ea lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631f8 expref: 8 pid: 6594 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969432.020931:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 44 00000100:00100000:1.0:1783969432.020941:0:8304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+8:2351:x1870627272173056:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969432.020956:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969432.020979:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c77b7753/0xbacf56d076fab2ea lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631f8 expref: 8 pid: 6594 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.021004:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c77b7753/0xbacf56d076fab2ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631f8 expref: 8 pid: 6594 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.021033:0:8304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783969432.021037:0:8304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783969432.021043:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000035509dad/0xbacf56d076fab2ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.021071:0:8304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035509dad/0xbacf56d076fab2ff lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.021093:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969432.021142:0:8304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+8:2351:x1870627272173056:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 202us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969432.021149:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 44 00010000:00010000:3.0:1783969432.021532:0:6594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c77b7753/0xbacf56d076fab2ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631f8 expref: 7 pid: 6594 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969432.021549:0:6594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7960e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6594:1870627280582144:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783969432.021579:0:6594:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000035509dad/0xbacf56d076fab2ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.021589:0:6594:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000035509dad/0xbacf56d076fab2ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.021595:0:6594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035509dad/0xbacf56d076fab2ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.021620:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000035509dad/0xbacf56d076fab2ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.021629:0:6594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035509dad/0xbacf56d076fab2ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.021637:0:6594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035509dad/0xbacf56d076fab2ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.021644:0:6594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6800 already unused, calling callback (ffffffffc1485230) 00010000:00010000:3.0:1783969432.021648:0:6594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035509dad/0xbacf56d076fab2ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.021657:0:6594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035509dad/0xbacf56d076fab2ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.021669:0:6594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035509dad/0xbacf56d076fab2ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.021685:0:6594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035509dad/0xbacf56d076fab2ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969432.021751:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+6:2350:x1870627272172928:12345-192.168.203.39@tcp:1:lhsmtool_posix.0 Request processed in 8026us (8188us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969432.021760:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 32 00000100:00100000:0.0:1783969432.039758:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969432.039930:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272173312 00000100:00100000:1.0:1783969432.039939:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272173312 00000100:00100000:1.0:1783969432.039998:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 83 00000100:00100000:1.0:1783969432.040009:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+12:10428:x1870627272173312:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783969432.040086:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab306 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.040102:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab306 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.040114:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab306 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.041534:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab30d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.041555:0:10288:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab2c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631e3 expref: 13 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.041564:0:10288:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab30d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.041620:0:10288:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab2c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631e3 expref: 13 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.041635:0:10288:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab2c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631e3 expref: 13 pid: 5794 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969432.041648:0:10288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bea300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10288:1870627280582272:192.168.203.39@tcp:104: 00000100:00100000:1.0:1783969432.041776:0:10288:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7c18e2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969432.057921:0:10288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bea300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10288:1870627280582272:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969432.057947:0:10288:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab30d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969432.058164:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969432.058572:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272173440 00000100:00100000:2.0:1783969432.058579:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272173440 00010000:00010000:2.0:1783969432.058613:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab2c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631e3 expref: 14 pid: 5794 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969432.058651:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 45 00000100:00100000:2.0:1783969432.058661:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+14:2351:x1870627272173440:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969432.058675:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969432.058681:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab2c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631e3 expref: 14 pid: 5794 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.058693:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab2c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631e3 expref: 14 pid: 5794 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.058713:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab2c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631e3 expref: 14 pid: 5794 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.058726:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ac7829e0e00) 00010000:00010000:2.0:1783969432.058731:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab30d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.058751:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab30d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.058758:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab30d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.058797:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969432.058852:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+13:2351:x1870627272173440:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 192us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969432.058884:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 45 00010000:00010000:0.0:1783969432.059500:0:10288:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab30d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.059510:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab30d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783969432.059697:0:10288:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1783969432.059854:0:10288:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1783969432.060153:0:10288:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1783969432.060253:0:10288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a76c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10288:1870627280582400:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783969432.060319:0:10288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969432.060384:0:10288:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7860b0480 going to sleep for 11 seconds 00000100:00100000:3.0:1783969432.061395:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280582400 00000100:00100000:3.0:1783969432.061404:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280582400 00000100:00100000:3.0:1783969432.063044:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783969432.063063:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10288:x1870627280582400:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783969432.063180:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10288:x1870627280582400:12345-0@lo:1000:mdt00_004.0 Request processed in 125us (2860us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969432.063188:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783969432.066800:0:10288:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1783969432.066811:0:10288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ac7a7961f80, transno 4294967303 00000100:00100000:2.0:1783969432.066832:0:10288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a76c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10288:1870627280582400:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1783969432.067505:0:10288:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1783969432.067601:0:10288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10288:1870627280582528:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1783969432.067663:0:10288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969432.068113:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280582528 00000100:00100000:0.0:1783969432.068122:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280582528 00000100:00100000:2.0:1783969432.068133:0:10288:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa2d480 going to sleep for 11 seconds 00000100:00100000:0.0:1783969432.068415:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783969432.068426:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10288:x1870627280582528:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1783969432.068908:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10288:x1870627280582528:12345-0@lo:1000:mdt00_004.0 Request processed in 482us (1242us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1783969432.068917:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783969432.069237:0:10288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10288:1870627280582528:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1783969432.069277:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab30d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.069288:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab30d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.069296:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab30d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.069302:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60ee00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969432.069307:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab30d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.069324:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab30d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.069340:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ac7829e0e00) 00010000:00010000:3.0:1783969432.069343:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783969432.069348:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab30d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.069354:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fab30d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.069390:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045800/0xbacf56d076fab242 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.069396:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045800/0xbacf56d076fab242 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.069402:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045800/0xbacf56d076fab242 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.069407:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2045800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969432.072254:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045800/0xbacf56d076fab242 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.072282:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045800/0xbacf56d076fab242 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.072300:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac785336400) 00010000:00010000:3.0:1783969432.072303:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783969432.072308:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045800/0xbacf56d076fab242 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.072327:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045800/0xbacf56d076fab242 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.076973:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076fab314 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.077008:0:10288:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab25e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631c7 expref: 16 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.077017:0:10288:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076fab314 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.077059:0:10288:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab25e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631c7 expref: 16 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.077074:0:10288:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab25e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631c7 expref: 16 pid: 10288 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969432.077088:0:10288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1be8700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10288:1870627280582656:192.168.203.39@tcp:104: 00000100:00100000:1.0:1783969432.077171:0:10288:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7c18e2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783969432.080425:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969432.080659:0:8304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272173568 00000100:00100000:0.0:1783969432.080669:0:8304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272173568 00010000:00010000:0.0:1783969432.080716:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab25e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631c7 expref: 17 pid: 10288 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969432.080755:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 46 00000100:00100000:0.0:1783969432.080765:0:8304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7960e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+17:2351:x1870627272173568:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969432.080779:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969432.080786:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab25e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631c7 expref: 17 pid: 10288 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.080799:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab25e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631c7 expref: 17 pid: 10288 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.080821:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac785336400) 00010000:00010000:0.0:1783969432.080826:0:8304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076fab314 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.080849:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076fab314 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.080882:0:8304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076fab314 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.080903:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969432.080952:0:8304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7960e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+17:2351:x1870627272173568:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 188us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969432.080960:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 46 00010000:00010000:1.0:1783969432.082183:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab25e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631c7 expref: 16 pid: 10288 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969432.082225:0:10288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1be8700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10288:1870627280582656:192.168.203.39@tcp:104: 00010000:00010000:1.0:1783969432.082250:0:10288:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076fab314 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.082260:0:10288:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076fab314 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.082266:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076fab314 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.082278:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076fab314 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.082284:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076fab314 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.082291:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076fab314 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.082310:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60e800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969432.082315:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076fab314 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.082321:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076fab314 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.082335:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac785336400) 00010000:00010000:1.0:1783969432.082337:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969432.082341:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076fab314 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.082353:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076fab314 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.082363:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab306 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.082369:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab306 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.082374:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab306 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.082379:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60e200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969432.082382:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab306 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.082387:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab306 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.082395:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac785336400) 00010000:00010000:1.0:1783969432.082397:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783969432.082400:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab306 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.082405:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab306 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969432.082719:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+15:10428:x1870627272173312:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 42701us (42960us total) trans 4294967361 rc 0/0 00000100:00100000:1.0:1783969432.082728:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 83 00000020:00080000:1.0:1783969432.082741:0:10288:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1783969432.083068:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783969432.083073:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783969432.083100:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1783969432.083106:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783969432.090818:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969432.090876:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272173824 00000100:00100000:3.0:1783969432.090884:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272173824 00000100:00100000:3.0:1783969432.090931:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:3.0:1783969432.090940:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+15:10428:x1870627272173824:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783969432.091920:0:5797:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783969432.092030:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00010000:00010000:3.0:1783969432.092077:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab31b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.092093:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab31b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.092105:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab31b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.092113:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab31b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.092119:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab31b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.092125:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab31b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.092147:0:5797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783969432.092245:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+17:10428:x1870627272173824:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 1304us (1434us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1783969432.092255:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 20 00000020:00080000:3.0:1783969432.092260:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783969432.092442:0:8303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969432.092449:0:8303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab31b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.092456:0:8303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6800 already unused, calling callback (ffffffffc1485230) 00010000:00010000:2.0:1783969432.092460:0:8303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab31b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.092468:0:8303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab31b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.092481:0:8303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ac78c550500) 00010000:00010000:2.0:1783969432.092489:0:8303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783969432.092494:0:8303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab31b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.092500:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab31b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.092515:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969432.092517:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969432.092518:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969432.103388:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969432.165452:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783969432.165474:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1be8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280582784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783969432.166012:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969432.166179:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280582784 00000100:00100000:3.0:1783969432.166186:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280582784 00000100:00100000:3.0:1783969432.166228:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783969432.166237:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1870627280582784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783969432.166269:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783969432.166373:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7961c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1870627280582784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969432.166381:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783969432.166424:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1be8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280582784:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1783969432.169064:0:11849:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783969432.169072:0:11849:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783969432.169110:0:11849:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1783969432.169116:0:11849:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783969432.267566:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969432.267629:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272174080 00000100:00100000:2.0:1783969432.267637:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272174080 00000100:00100000:2.0:1783969432.267695:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 84 00000100:00100000:2.0:1783969432.269461:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+17:10438:x1870627272174080:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783969432.269498:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969432.269533:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab322 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb631ff expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.269776:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045800/0xbacf56d076fab329 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.270429:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045800/0xbacf56d076fab329 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.270443:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045800/0xbacf56d076fab329 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969432.270468:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1783969432.270663:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab322 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631ff expref: 20 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.270682:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045800/0xbacf56d076fab329 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631ff expref: 19 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.270690:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:2.0:1783969432.270693:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783969432.270696:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c2045800, rc 0) 00000100:00100000:2.0:1783969432.271226:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+19:10438:x1870627272174080:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3519us (3665us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1783969432.271235:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 84 00000100:00100000:0.0:1783969432.279530:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969432.279606:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272174208 00000100:00100000:1.0:1783969432.279614:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272174208 00000100:00100000:1.0:1783969432.279671:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 85 00000100:00100000:1.0:1783969432.279682:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+19:10438:x1870627272174208:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:1.0:1783969432.279753:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f000/0xbacf56d076fab337 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.279770:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f000/0xbacf56d076fab337 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.279794:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f000/0xbacf56d076fab337 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.279810:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fab33e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.279816:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fab33e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.279823:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fab33e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.280287:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076fab345 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.280309:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076fab345 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.280318:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076fab345 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783969432.280354:0:6618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076fab345 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.280373:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f000/0xbacf56d076fab337 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.280380:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f000/0xbacf56d076fab337 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.280387:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f000/0xbacf56d076fab337 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.280393:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60f000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969432.280398:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f000/0xbacf56d076fab337 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.280406:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f000/0xbacf56d076fab337 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.280417:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:1.0:1783969432.280420:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969432.280424:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f000/0xbacf56d076fab337 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.280431:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f000/0xbacf56d076fab337 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.280442:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fab33e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.280449:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fab33e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.280456:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fab33e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.280469:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60f200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969432.280472:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fab33e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.280478:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fab33e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.280487:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ac7829e0a00) 00010000:00010000:1.0:1783969432.280490:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969432.280493:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fab33e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.280499:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fab33e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.280516:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076fab345 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.280522:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076fab345 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.280528:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076fab345 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.280533:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60e400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969432.280536:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076fab345 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.280542:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076fab345 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.280561:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac7829e0f00) 00010000:00010000:1.0:1783969432.280563:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969432.280566:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076fab345 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.280572:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076fab345 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969432.280654:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+19:10438:x1870627272174208:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 972us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969432.280664:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 85 00000100:00100000:2.0:1783969432.333552:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969432.333589:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272174464 00000100:00100000:2.0:1783969432.333598:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272174464 00000100:00100000:2.0:1783969432.333657:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 86 00000100:00100000:2.0:1783969432.333667:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+19:10441:x1870627272174464:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783969432.333688:0:10288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969432.333708:0:10288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab34c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63206 expref: -99 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.333786:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab353 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.333800:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab353 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.333834:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab353 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.333850:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab35a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.333880:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab35a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.333888:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab35a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.334220:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab361 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.334230:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab361 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.334237:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab361 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969432.334246:0:10288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1783969432.334341:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab353 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.334349:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab353 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.334355:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab353 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.334361:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2045200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969432.334371:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab353 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.334379:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab353 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.334390:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:2.0:1783969432.334393:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969432.334397:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab353 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.334404:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab353 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.334416:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab35a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.334421:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab35a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.334427:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab35a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.334432:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2044c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969432.334435:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab35a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.334440:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab35a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.334447:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ac785336900) 00010000:00010000:2.0:1783969432.334449:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969432.334457:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab35a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.334463:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab35a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.334500:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab34c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63206 expref: 22 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.334512:0:10288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab361 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63206 expref: 21 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.334518:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac785336600) 00010000:00010000:2.0:1783969432.334521:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783969432.334523:0:10288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c2045a00, rc 0) 00000100:00100000:2.0:1783969432.334587:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+21:10441:x1870627272174464:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 922us (1044us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1783969432.334595:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 86 00000100:00100000:3.0:1783969432.340615:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969432.340768:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272174592 00000100:00100000:2.0:1783969432.340777:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272174592 00000100:00100000:2.0:1783969432.340839:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 87 00000100:00100000:2.0:1783969432.340849:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+21:10441:x1870627272174592:12345-192.168.203.39@tcp:54:lfs.0 00010000:00010000:2.0:1783969432.340933:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab36f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.340949:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab36f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.340961:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab36f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.341007:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab36f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.341024:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab36f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.341030:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab36f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.341036:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2044800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969432.341040:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab36f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.341048:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab36f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.341060:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac785336600) 00010000:00010000:2.0:1783969432.341063:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783969432.341067:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab36f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.341073:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab36f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969432.341142:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+21:10441:x1870627272174592:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 294us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969432.341149:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 87 00000100:00100000:3.0:1783969432.342968:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969432.343181:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272174848 00000100:00100000:2.0:1783969432.343196:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272174848 00000100:00100000:2.0:1783969432.343250:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:2.0:1783969432.343276:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786073050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+21:10441:x1870627272174848:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1783969432.343510:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786073050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+22:10441:x1870627272174848:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 241us (554us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1783969432.343517:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:1.0:1783969432.392252:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969432.394679:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272175104 00000100:00100000:1.0:1783969432.394690:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272175104 00000100:00100000:1.0:1783969432.394761:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 88 00000100:00100000:1.0:1783969432.394771:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+22:9970:x1870627272175104:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:1.0:1783969432.396141:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969432.396163:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f000/0xbacf56d076fab376 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6320d expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.396260:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fab37d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.396278:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab361 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63206 expref: 23 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.396289:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fab37d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.396887:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab361 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63206 expref: 23 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.396902:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab361 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63206 expref: 23 pid: 10288 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969432.396916:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1870627280582912:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783969432.399575:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969432.399659:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7c18e2900 going to sleep for 11 seconds 00000100:00100000:1.0:1783969432.399689:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1870627280582912:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783969432.400157:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272175232 00000100:00100000:2.0:1783969432.400164:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272175232 00010000:00010000:2.0:1783969432.400204:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab361 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63206 expref: 24 pid: 10288 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969432.400238:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 47 00000100:00100000:2.0:1783969432.400247:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7960380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+24:2350:x1870627272175232:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969432.400259:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969432.400265:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab361 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63206 expref: 24 pid: 10288 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.400278:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab361 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63206 expref: 24 pid: 10288 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.400299:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab361 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63206 expref: 24 pid: 10288 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.400324:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac785336600) 00010000:00010000:2.0:1783969432.400329:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fab37d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.400337:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fab37d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.400356:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fab37d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.400373:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969432.400429:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7960380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+23:2350:x1870627272175232:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 182us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969432.400437:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 47 00010000:00010000:1.0:1783969432.401241:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fab37d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.401254:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fab37d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.401260:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fab37d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969432.401277:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1783969432.401436:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f000/0xbacf56d076fab376 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6320d expref: 24 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.401452:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fab37d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6320d expref: 23 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.401460:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac785336600) 00010000:00010000:1.0:1783969432.401462:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783969432.401473:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bf60f800, rc 0) 00000100:00100000:1.0:1783969432.401527:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1beaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+23:9970:x1870627272175104:12345-192.168.203.39@tcp:101:bash.0 Request processed in 6757us (9281us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1783969432.401535:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 88 00000100:00100000:2.0:1783969432.418752:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969432.419464:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272175488 00000100:00100000:0.0:1783969432.419475:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272175488 00000100:00100000:0.0:1783969432.419560:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 89 00000100:00100000:0.0:1783969432.419570:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+23:9970:x1870627272175488:12345-192.168.203.39@tcp:36:bash.0 00010000:00010000:0.0:1783969432.419814:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab38b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.419829:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab38b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.419841:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab38b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783969432.419938:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000004:00010000:0.0:1783969432.419963:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007a7c9d3e reply state 000000006db63753 transno 4294967369 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab38b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969432.419973:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1783969432.420032:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000100:00100000:0.0:1783969432.420123:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+27:9970:x1870627272175488:12345-192.168.203.39@tcp:36:bash.0 Request processed in 553us (1380us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1783969432.420131:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 89 00000020:00080000:0.0:1783969432.420135:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1783969432.422244:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab38b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.422259:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab38b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.422266:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab38b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.422272:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969432.422276:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab38b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.422283:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab38b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.422298:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac785336600) 00010000:00010000:0.0:1783969432.422301:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969432.422306:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab38b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.422330:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab38b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969432.426191:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969432.426556:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272175616 00000100:00100000:3.0:1783969432.426565:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272175616 00000100:00100000:3.0:1783969432.426652:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 90 00000100:00100000:3.0:1783969432.426662:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+26:9970:x1870627272175616:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:3.0:1783969432.426685:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969432.426706:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fab392 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63214 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.426778:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fab392 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63214 expref: 27 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.426802:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fab392 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63214 expref: 27 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.426821:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac785336600) 00010000:00010000:3.0:1783969432.426824:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783969432.426827:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7a00, rc 0) 00000100:00100000:3.0:1783969432.426920:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+27:9970:x1870627272175616:12345-192.168.203.39@tcp:101:bash.0 Request processed in 259us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969432.426928:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 90 00000100:00100000:3.0:1783969432.429157:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969432.429250:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272175744 00000100:00100000:0.0:1783969432.429258:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272175744 00000100:00100000:0.0:1783969432.429307:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 33 00000100:00100000:0.0:1783969432.429316:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+6:9970:x1870627272175744:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:0.0:1783969432.429332:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969432.429350:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fab399 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6321b expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783969432.429375:0:6593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a553697, atime: 0x6a553695, ctime: 0x6a553697, blocks: 0xb 00010000:00010000:0.0:1783969432.429394:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=289s v=(0 0) 00010000:00010000:0.0:1783969432.429399:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969432.429406:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fab399 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6321b expref: 7 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.429420:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fab399 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6321b expref: 7 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.429432:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93000, rc 0) 00000100:00100000:0.0:1783969432.429482:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7962300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+7:9970:x1870627272175744:12345-192.168.203.39@tcp:101:bash.0 Request processed in 167us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969432.429489:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 33 00000100:00100000:1.0:1783969432.432654:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969432.432741:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272175872 00000100:00100000:3.0:1783969432.432750:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272175872 00002000:00010000:3.0:1783969432.432787:0:6598:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1783969432.432792:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac7c1bebb80 with x1870627272175872 ext(0->18446744073709551615) 00002000:00010000:3.0:1783969432.432803:0:6598:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ac7c1bebb80. 00000100:00100000:3.0:1783969432.432834:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1 00000100:00100000:3.0:1783969432.432843:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:03985e57-ffb4-414b-b30c-e72697857d4f+7:2350:x1870627272175872:12345-192.168.203.39@tcp:10:bash.0 00002000:00010000:2.0:1783969432.433287:0:6598:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1783969432.433292:0:6598:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1783969431 -> 1783969432 00002000:00010000:2.0:1783969432.433294:0:6598:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1783969429 -> 1783969429 00002000:00010000:2.0:1783969432.433297:0:6598:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1783969431 -> 1783969432 00002000:00010000:2.0:1783969432.433300:0:6598:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1783969432.433360:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:03985e57-ffb4-414b-b30c-e72697857d4f+8:2350:x1870627272175872:12345-192.168.203.39@tcp:10:bash.0 Request processed in 517us (713us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1783969432.433372:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1 00002000:00010000:2.0:1783969432.433376:0:6598:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1783969432.433378:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac7c1bebb80 with x1870627272175872 ext(0->18446744073709551615) 00002000:00010000:2.0:1783969432.433383:0:6598:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ac7c1bebb80. 00000100:00100000:2.0:1783969432.493789:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969432.494100:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272176000 00000100:00100000:1.0:1783969432.494110:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272176000 00000100:00100000:1.0:1783969432.494205:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 91 00000100:00100000:1.0:1783969432.494215:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+27:10455:x1870627272176000:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:1.0:1783969432.494279:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076fab3a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494307:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076fab3a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494326:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076fab3a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494341:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab3a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494348:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab3a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494355:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab3a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494647:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fa00/0xbacf56d076fab3ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494657:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fa00/0xbacf56d076fab3ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494671:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fa00/0xbacf56d076fab3ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783969432.494718:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fa00/0xbacf56d076fab3ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494730:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076fab3a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494736:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076fab3a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494742:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076fab3a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494748:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60fc00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969432.494752:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076fab3a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494759:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076fab3a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494770:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:1.0:1783969432.494773:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969432.494788:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076fab3a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494796:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076fab3a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494809:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab3a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494821:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab3a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494828:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab3a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494833:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60ec00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969432.494836:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab3a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494842:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab3a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494851:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ac7829e0f00) 00010000:00010000:1.0:1783969432.494853:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969432.494911:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab3a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494919:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab3a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494934:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fa00/0xbacf56d076fab3ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494940:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fa00/0xbacf56d076fab3ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494947:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fa00/0xbacf56d076fab3ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494952:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60fa00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969432.494961:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fa00/0xbacf56d076fab3ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494967:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fa00/0xbacf56d076fab3ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.494975:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac785336600) 00010000:00010000:1.0:1783969432.494977:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969432.494980:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fa00/0xbacf56d076fab3ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.495000:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fa00/0xbacf56d076fab3ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969432.495077:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+27:10455:x1870627272176000:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 863us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969432.495086:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 91 00000100:00100000:3.0:1783969432.529256:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969432.529321:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272176256 00000100:00100000:0.0:1783969432.529328:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272176256 00000100:00100000:0.0:1783969432.529385:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 92 00000100:00100000:0.0:1783969432.529393:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+27:10458:x1870627272176256:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783969432.529409:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969432.529435:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab3b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63222 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.529508:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab3bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.529523:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab3bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.529534:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab3bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.529549:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab3c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.529556:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.529562:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.530176:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab3ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.530187:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab3ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.530195:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab3ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969432.530216:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783969432.530409:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab3bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.530496:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab3bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.530503:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab3bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.530509:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969432.530513:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab3bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.530520:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab3bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.530532:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:0.0:1783969432.530535:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969432.530539:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab3bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.530545:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab3bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.530556:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab3c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.530563:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab3c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.530580:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab3c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.530585:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969432.530588:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab3c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.530594:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab3c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.530602:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ac790086900) 00010000:00010000:0.0:1783969432.530605:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969432.530608:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab3c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.530614:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab3c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.530659:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab3b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63222 expref: 30 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.530672:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab3ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63222 expref: 29 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.530679:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac785336600) 00010000:00010000:0.0:1783969432.530682:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783969432.530684:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92e00, rc 0) 00000100:00100000:0.0:1783969432.530791:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+29:10458:x1870627272176256:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1397us (1540us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1783969432.530808:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 92 00000100:00100000:2.0:1783969432.534193:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969432.534283:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272176384 00000100:00100000:3.0:1783969432.534292:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272176384 00000100:00100000:3.0:1783969432.534542:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 93 00000100:00100000:3.0:1783969432.534553:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+29:10458:x1870627272176384:12345-192.168.203.39@tcp:54:lfs.0 00010000:00010000:3.0:1783969432.534633:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab3d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.534650:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fab37d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6320d expref: 29 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.534659:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab3d8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.534691:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fab37d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6320d expref: 29 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.534704:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fab37d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6320d expref: 29 pid: 5793 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969432.534718:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7962a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1870627280583040:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783969432.534921:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bf74c240 going to sleep for 11 seconds 00000100:00100000:3.0:1783969432.537333:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7962a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1870627280583040:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783969432.537361:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab3d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969432.538468:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969432.538964:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272176640 00000100:00100000:0.0:1783969432.538973:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272176640 00000100:00100000:0.0:1783969432.539036:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:0.0:1783969432.539045:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+30:5578:x1870627272176640:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783969432.539362:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+31:5578:x1870627272176640:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 317us (896us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1783969432.539369:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:2.0:1783969432.544609:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969432.545068:0:8304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272176768 00000100:00100000:0.0:1783969432.545078:0:8304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272176768 00010000:00010000:0.0:1783969432.545118:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fab37d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6320d expref: 31 pid: 5793 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969432.545159:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 48 00000100:00100000:0.0:1783969432.545172:0:8304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+31:2350:x1870627272176768:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969432.545188:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969432.545196:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fab37d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6320d expref: 31 pid: 5793 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.545209:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fab37d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6320d expref: 31 pid: 5793 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.545231:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fab37d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6320d expref: 31 pid: 5793 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.545248:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac785336600) 00010000:00010000:0.0:1783969432.545266:0:8304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab3d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.545277:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.545285:0:8304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab3d8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.545580:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969432.545639:0:8304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+30:2350:x1870627272176768:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 471us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969432.545647:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 48 00010000:00010000:2.0:1783969432.547062:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.547095:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.547127:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.547134:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab3d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.547140:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab3d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.547147:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969432.547151:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab3d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.547158:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab3d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.547171:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac785336600) 00010000:00010000:2.0:1783969432.547174:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783969432.547178:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab3d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.547184:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab3d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969432.547427:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7aeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+29:10458:x1870627272176384:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 12871us (13238us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969432.547437:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 93 00000100:00100000:2.0:1783969432.549686:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969432.549761:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272177024 00000100:00100000:0.0:1783969432.549770:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272177024 00000100:00100000:0.0:1783969432.549827:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 23 00000100:00100000:0.0:1783969432.549837:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+29:10458:x1870627272177024:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1783969432.550119:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+30:10458:x1870627272177024:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 281us (440us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1783969432.550127:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 23 00000100:00100000:1.0:1783969432.636254:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969432.636420:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272177280 00000100:00100000:0.0:1783969432.636429:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272177280 00000100:00100000:0.0:1783969432.636484:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 94 00000100:00100000:0.0:1783969432.636493:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+30:10469:x1870627272177280:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:0.0:1783969432.636515:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969432.636536:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab3df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63229 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.636618:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab3e6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.636636:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab3e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.636647:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab3e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.636659:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab3ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.636665:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab3ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.636670:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab3ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.636978:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab3f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.636996:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.637003:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab3f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969432.637012:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1783969432.637089:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab3e6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.637095:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab3e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.637102:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab3e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.637113:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969432.637117:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab3e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.637124:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab3e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.637134:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:0.0:1783969432.637137:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969432.637141:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab3e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.637146:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab3e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.637156:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab3ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.637161:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab3ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.637166:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab3ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.637170:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969432.637173:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab3ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.637178:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab3ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.637194:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ac790086900) 00010000:00010000:0.0:1783969432.637196:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969432.637199:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab3ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.637206:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab3ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.637238:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab3df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63229 expref: 33 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.637249:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab3f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63229 expref: 32 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.637255:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac785336600) 00010000:00010000:0.0:1783969432.637257:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969432.637260:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93e00, rc 0) 00000100:00100000:0.0:1783969432.637481:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+32:10469:x1870627272177280:12345-192.168.203.39@tcp:101:cat.0 Request processed in 987us (1233us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1783969432.637488:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 94 00000100:00100000:2.0:1783969432.644402:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969432.644544:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272177536 00000100:00100000:0.0:1783969432.644552:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272177536 00000100:00100000:0.0:1783969432.644603:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 24 00000100:00100000:0.0:1783969432.644612:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+32:10469:x1870627272177536:12345-192.168.203.39@tcp:35:cat.0 00000100:00100000:0.0:1783969432.644856:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+33:10469:x1870627272177536:12345-192.168.203.39@tcp:35:cat.0 Request processed in 243us (461us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1783969432.644885:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 24 00000100:00100000:2.0:1783969432.662135:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969432.662227:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272177792 00000100:00100000:0.0:1783969432.662237:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272177792 00000100:00100000:0.0:1783969432.662304:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 95 00000100:00100000:0.0:1783969432.662315:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+33:10470:x1870627272177792:12345-192.168.203.39@tcp:36:rm.0 00010000:00010000:0.0:1783969432.662370:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783969432.662396:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab3f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63229 expref: 33 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.662418:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab3ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63222 expref: 32 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.662430:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fab392 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63214 expref: 31 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.662440:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac785336600) 00010000:00010000:0.0:1783969432.662450:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783969432.662469:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab402 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.662482:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab402 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.662491:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab402 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.662504:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab409 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.662511:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab409 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.662535:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab409 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.662824:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab410 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.662833:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab410 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.662840:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab410 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783969432.663510:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1783969432.663518:0:5794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 289745658497ns, next at 290745656776ns, rc = 0 00010000:00010000:0.0:1783969432.663572:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab417 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.663582:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab417 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.663591:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab417 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.663598:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab417 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.663603:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab417 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.663608:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab417 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.663644:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783969432.663663:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab410 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.663668:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab410 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.663673:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab410 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.663678:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969432.663682:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab410 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.663688:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab410 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.663698:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086c00) 00010000:00010000:0.0:1783969432.663700:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783969432.663704:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab410 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.663710:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab410 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.663726:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab402 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.663731:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab402 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.663736:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab402 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.663747:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969432.663749:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab402 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.663755:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab402 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.663762:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:0.0:1783969432.663764:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969432.663767:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab402 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.663772:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab402 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783969432.663780:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000678b3d14 reply state 000000000dd2d7a8 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab409 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969432.663788:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783969432.663890:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+32:10470:x1870627272177792:12345-192.168.203.39@tcp:36:rm.0 Request processed in 1544us (1731us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1783969432.663899:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 95 00010000:00010000:3.0:1783969432.664102:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969432.664109:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab417 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.664115:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92400 already unused, calling callback (ffffffffc1485230) 00010000:00010000:3.0:1783969432.664118:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab417 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.664135:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab417 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.664143:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ac790086c00) 00010000:00010000:3.0:1783969432.664145:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783969432.664148:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab417 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.664153:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab417 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.664166:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969432.664168:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969432.664170:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969432.669407:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab409 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.669424:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab409 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.669432:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab409 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.669455:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969432.669460:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab409 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.669467:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab409 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.669483:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ac790086900) 00010000:00010000:0.0:1783969432.669485:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969432.669490:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab409 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.669496:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab409 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969432.710307:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969432.710636:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272178048 00000100:00100000:3.0:1783969432.710646:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272178048 00000100:00100000:3.0:1783969432.710706:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 96 00000100:00100000:3.0:1783969432.710716:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+31:10476:x1870627272178048:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:3.0:1783969432.710747:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969432.710769:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab41e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63230 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.710911:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab425 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.710924:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab425 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.710935:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab425 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.710964:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fab42c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.710971:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fab42c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.710977:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fab42c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783969432.711727:0:5795:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1783969432.711965:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab433 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.711976:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.711993:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.712024:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab425 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.712030:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab425 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.712036:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab425 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.712042:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de7800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969432.712045:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab425 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.712062:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab425 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.712074:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:3.0:1783969432.712076:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969432.712080:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab425 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.712086:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab425 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783969432.712096:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000005959d27 reply state 00000000608c4f7a transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fab42c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969432.712105:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783969432.712131:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab41e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63230 expref: 34 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.712419:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab433 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63230 expref: 33 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.712427:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:3.0:1783969432.712429:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783969432.712432:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de6000, rc 0) 00000100:00100000:3.0:1783969432.712500:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+34:10476:x1870627272178048:12345-192.168.203.39@tcp:101:bash.0 Request processed in 1785us (2206us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1783969432.712509:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 96 00010000:00010000:0.0:1783969432.715470:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fab42c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.715488:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fab42c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.715495:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fab42c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.715501:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de7a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969432.715505:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fab42c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.715512:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fab42c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.715547:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ac78c550900) 00010000:00010000:0.0:1783969432.715550:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969432.715554:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fab42c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.715560:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fab42c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969432.718533:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969432.719016:0:9934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272178176 00000100:00100000:1.0:1783969432.719029:0:9934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272178176 00000100:00100000:1.0:1783969432.719106:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 34 00000100:00100000:1.0:1783969432.719117:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+5:2351:x1870627272178176:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:1.0:1783969432.719143:0:9934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969432.719168:0:9934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af722a59/0xbacf56d076fab441 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63237 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783969432.719195:0:9934:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783969432.719212:0:9934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=289s v=(0 0) 00010000:00010000:1.0:1783969432.719216:0:9934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969432.719238:0:9934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af722a59/0xbacf56d076fab441 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63237 expref: 6 pid: 9934 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.719255:0:9934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000af722a59/0xbacf56d076fab441 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63237 expref: 6 pid: 9934 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.719268:0:9934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bf60e600, rc 0) 00000100:00100000:1.0:1783969432.719418:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+6:2351:x1870627272178176:12345-192.168.203.39@tcp:101:bash.0 Request processed in 303us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969432.719426:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 34 00000100:00080000:2.0:1783969432.719572:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969432.726502:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969432.726589:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272178304 00000100:00100000:0.0:1783969432.726599:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272178304 00000100:00100000:0.0:1783969432.726651:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 35 00000100:00100000:0.0:1783969432.726661:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1beb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+6:10476:x1870627272178304:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:0.0:1783969432.726677:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969432.726693:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fab448 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6323e expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.726721:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000af722a59/0xbacf56d076fab441 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63237 expref: 7 pid: 9934 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.726729:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969432.726743:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969432.726749:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fab448 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6323e expref: 7 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.726789:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000af722a59/0xbacf56d076fab441 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63237 expref: 7 pid: 9934 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.726822:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000af722a59/0xbacf56d076fab441 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63237 expref: 7 pid: 9934 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969432.726835:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac787780380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6593:1870627280583168:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783969432.727116:0:6593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7860b0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969432.729797:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac787780380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6593:1870627280583168:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783969432.729849:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fab448 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6323e expref: 7 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.729904:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93800, rc 0) 00000100:00100000:3.0:1783969432.729961:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1beb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+7:10476:x1870627272178304:12345-192.168.203.39@tcp:101:bash.0 Request processed in 3300us (3467us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969432.729969:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 35 00000100:00100000:2.0:1783969432.732101:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969432.732262:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272178432 00000100:00100000:0.0:1783969432.732270:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272178432 00010000:00010000:0.0:1783969432.732318:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000af722a59/0xbacf56d076fab441 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63237 expref: 7 pid: 9934 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969432.732357:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 49 00000100:00100000:0.0:1783969432.732367:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a63c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+7:2349:x1870627272178432:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969432.732381:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969432.732403:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000af722a59/0xbacf56d076fab441 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63237 expref: 7 pid: 9934 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.732417:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000af722a59/0xbacf56d076fab441 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63237 expref: 7 pid: 9934 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.732439:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af722a59/0xbacf56d076fab441 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63237 expref: 7 pid: 9934 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.732455:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969432.732470:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969432.732479:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fab448 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6323e expref: 6 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.732489:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fab448 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6323e expref: 6 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.732524:0:5778:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fab448 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6323e expref: 6 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969432.732537:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac787782300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5778:1870627280583296:192.168.203.39@tcp:105: 00000100:00100000:0.0:1783969432.732613:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7860b0480 going to sleep for 11 seconds 00000100:00100000:1.0:1783969432.736802:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969432.736933:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac787782300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5778:1870627280583296:192.168.203.39@tcp:105: 00010000:00010000:0.0:1783969432.736955:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969432.737011:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a63c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+6:2349:x1870627272178432:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 4645us (4918us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969432.737022:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 49 00000100:00100000:2.0:1783969432.737145:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272178688 00000100:00100000:2.0:1783969432.737152:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272178688 00000100:00100000:2.0:1783969432.737193:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 25 00000100:00100000:2.0:1783969432.737201:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+33:10476:x1870627272178688:12345-192.168.203.39@tcp:35:bash.0 00000100:00100000:2.0:1783969432.737472:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+34:10476:x1870627272178688:12345-192.168.203.39@tcp:35:bash.0 Request processed in 272us (680us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1783969432.737479:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 25 00000100:00100000:1.0:1783969432.902783:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969432.902897:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272178816 00000100:00100000:0.0:1783969432.902907:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272178816 00000100:00100000:0.0:1783969432.902979:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 97 00000100:00100000:0.0:1783969432.902997:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+34:10492:x1870627272178816:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783969432.903022:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969432.903043:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab44f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63245 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.903104:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab456 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.903133:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.903146:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969432.903203:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1783969432.903207:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783969432.903231:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab456 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.903256:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab44f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63245 expref: 36 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.903275:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab456 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63245 expref: 35 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.903284:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:0.0:1783969432.903298:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783969432.903302:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92e00, rc 0) 00000100:00100000:0.0:1783969432.903365:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+35:10492:x1870627272178816:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 371us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969432.903373:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 97 00000100:00100000:1.0:1783969432.907502:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969432.907595:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272179072 00000100:00100000:3.0:1783969432.907604:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272179072 00000100:00100000:3.0:1783969432.907662:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 98 00000100:00100000:3.0:1783969432.907672:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+35:10492:x1870627272179072:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783969432.907691:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969432.907710:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab45d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6324c expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.907813:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab464 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.907824:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.907834:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969432.907844:0:6618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1783969432.908019:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab45d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6324c expref: 38 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.908037:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab464 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6324c expref: 37 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.908059:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:3.0:1783969432.908062:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783969432.908065:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7800, rc 0) 00000100:00100000:3.0:1783969432.908113:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+37:10492:x1870627272179072:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 443us (621us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1783969432.908119:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 98 00000100:00100000:1.0:1783969432.911798:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969432.911888:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272179328 00000100:00100000:3.0:1783969432.911897:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272179328 00000100:00100000:3.0:1783969432.911964:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 99 00000100:00100000:3.0:1783969432.911975:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+37:10492:x1870627272179328:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783969432.912006:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969432.912026:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab472 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63253 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.912115:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab479 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.912129:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.912140:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab479 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969432.912153:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1783969432.912272:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab472 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63253 expref: 40 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.912323:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab479 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63253 expref: 39 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.912332:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:3.0:1783969432.912335:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783969432.912339:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de6a00, rc 0) 00000100:00100000:3.0:1783969432.912397:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+39:10492:x1870627272179328:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 424us (607us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1783969432.912404:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 99 00000100:00100000:1.0:1783969432.919430:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969432.919542:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272179456 00000100:00100000:3.0:1783969432.919551:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272179456 00000100:00100000:3.0:1783969432.919617:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:3.0:1783969432.919626:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1beb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03985e57-ffb4-414b-b30c-e72697857d4f+39:2350:x1870627272179456:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969432.919643:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969432.919668:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab464 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6324c expref: 39 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.919686:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:3.0:1783969432.919690:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969432.919796:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1beb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03985e57-ffb4-414b-b30c-e72697857d4f+38:2350:x1870627272179456:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 170us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969432.919804:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:1.0:1783969432.922179:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969432.922558:0:9934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272179584 00000100:00100000:2.0:1783969432.922567:0:9934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272179584 00000100:00100000:2.0:1783969432.922622:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 36 00000100:00100000:2.0:1783969432.922633:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+6:2351:x1870627272179584:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1783969432.922674:0:9934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf749bed/0xbacf56d076fab487 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.922693:0:9934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fab448 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6323e expref: 6 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.922702:0:9934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1783969432.922719:0:9934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783969432.922724:0:9934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf749bed/0xbacf56d076fab487 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.923023:0:9934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fab448 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6323e expref: 6 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.923039:0:9934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fab448 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6323e expref: 6 pid: 6593 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969432.923054:0:9934:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac782fb1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9934:1870627280583424:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783969432.923132:0:9934:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac798c55840 going to sleep for 11 seconds 00000100:00100000:3.0:1783969432.927154:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969432.927773:0:9934:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac782fb1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9934:1870627280583424:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969432.927932:0:9934:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cf749bed/0xbacf56d076fab487 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969432.928018:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272179712 00000100:00100000:0.0:1783969432.928025:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272179712 00002000:00100000:0.0:1783969432.928072:0:6600:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9ac7a7962a00 x1870627272179712/t0(0) o4->03985e57-ffb4-414b-b30c-e72697857d4f@192.168.203.39@tcp:328/0 lens 504/0 e 0 to 0 dl 1783969443 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783969432.928081:0:6600:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac7a7962a00 with x1870627272179712 ext(0->8) 00010000:00010000:0.0:1783969432.928102:0:6600:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fab448 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6323e expref: 7 pid: 6593 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.928115:0:6600:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fab448 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6323e expref: 7 pid: 6593 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783969432.928123:0:6600:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ac7a7962a00 00000100:00100000:0.0:1783969432.928213:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1 00000100:00100000:0.0:1783969432.928223:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:03985e57-ffb4-414b-b30c-e72697857d4f+7:2350:x1870627272179712:12345-192.168.203.39@tcp:4:lfs.0 00000100:00100000:0.0:1783969432.929027:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7962a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:03985e57-ffb4-414b-b30c-e72697857d4f+9:2350:x1870627272179712:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 802us (1878us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1783969432.929035:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1 00002000:00100000:0.0:1783969432.929043:0:6600:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9ac7a7962a00 x1870627272179712/t4294967302(0) o4->03985e57-ffb4-414b-b30c-e72697857d4f@192.168.203.39@tcp:328/0 lens 504/448 e 0 to 0 dl 1783969443 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783969432.929051:0:6600:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac7a7962a00 with x1870627272179712 ext(0->8) 00010000:00010000:0.0:1783969432.929058:0:6600:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fab448 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6323e expref: 9 pid: 6593 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969432.929071:0:6600:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fab448 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6323e expref: 9 pid: 6593 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783969432.929078:0:6600:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ac7a7962a00 00000100:00100000:1.0:1783969432.931646:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969432.931846:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272179840 00000100:00100000:2.0:1783969432.931855:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272179840 00010000:00010000:2.0:1783969432.931907:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fab448 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6323e expref: 9 pid: 6593 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969432.931992:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 50 00000100:00100000:2.0:1783969432.932002:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+9:2351:x1870627272179840:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969432.932016:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783969432.932035:0:5779:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783969432.932038:0:5779:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783969432 00002000:00010000:2.0:1783969432.932040:0:5779:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783969432 00002000:00010000:2.0:1783969432.932042:0:5779:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1783969432 00010000:00010000:2.0:1783969432.932061:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fab448 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6323e expref: 9 pid: 6593 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.932075:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fab448 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6323e expref: 9 pid: 6593 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.932101:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fab448 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6323e expref: 9 pid: 6593 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.932117:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783969432.932121:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783969432.932127:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf749bed/0xbacf56d076fab487 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.932137:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf749bed/0xbacf56d076fab487 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.932173:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969432.932266:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+8:2351:x1870627272179840:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 264us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969432.932274:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 50 00010000:00010000:1.0:1783969432.932332:0:9934:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cf749bed/0xbacf56d076fab487 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.932341:0:9934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf749bed/0xbacf56d076fab487 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.932364:0:9934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf749bed/0xbacf56d076fab487 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.932381:0:9934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf749bed/0xbacf56d076fab487 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.932389:0:9934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf749bed/0xbacf56d076fab487 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.932395:0:9934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2045400 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969432.932398:0:9934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf749bed/0xbacf56d076fab487 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.932407:0:9934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf749bed/0xbacf56d076fab487 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.932419:0:9934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf749bed/0xbacf56d076fab487 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.932427:0:9934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf749bed/0xbacf56d076fab487 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969432.932474:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+7:2351:x1870627272179584:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 9843us (10302us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969432.932480:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 36 00000100:00100000:3.0:1783969432.934572:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969432.934722:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272180096 00000100:00100000:2.0:1783969432.934731:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272180096 00000100:00100000:2.0:1783969432.934826:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 26 00000100:00100000:2.0:1783969432.934837:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786072c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+38:10492:x1870627272180096:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:2.0:1783969432.934913:0:5796:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab479 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63253 expref: 38 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783969432.935188:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1783969432.935235:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1783969432.935548:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:2.0:1783969432.935601:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab48e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.935615:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab433 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63230 expref: 42 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.935623:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab48e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.935657:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab433 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63230 expref: 42 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.935671:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab433 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63230 expref: 42 pid: 5795 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969432.935684:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac782fb1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5796:1870627280583552:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783969432.936300:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac787d34840 going to sleep for 11 seconds 00000100:00100000:3.0:1783969432.939365:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969432.939612:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272180224 00000100:00100000:1.0:1783969432.939620:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272180224 00010000:00010000:1.0:1783969432.939653:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab433 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63230 expref: 43 pid: 5795 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969432.939694:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 51 00000100:00100000:1.0:1783969432.939703:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7963b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03985e57-ffb4-414b-b30c-e72697857d4f+43:2351:x1870627272180224:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969432.939727:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969432.939735:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab433 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63230 expref: 43 pid: 5795 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.939747:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab433 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63230 expref: 43 pid: 5795 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.939769:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:1.0:1783969432.939774:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab48e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.939790:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab48e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.939799:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab48e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969432.939816:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969432.939893:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7963b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03985e57-ffb4-414b-b30c-e72697857d4f+43:2351:x1870627272180224:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 190us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969432.939900:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 51 00010000:00010000:2.0:1783969432.940059:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab433 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63230 expref: 42 pid: 5795 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969432.940076:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac782fb1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5796:1870627280583552:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969432.940093:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab48e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.940111:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab48e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.940117:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab48e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783969432.940219:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:2.0:1783969432.940390:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1783969432.940472:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac782fb1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5796:1870627280583680:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783969432.940510:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969432.940542:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac790feb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969432.940972:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280583680 00000100:00100000:1.0:1783969432.940979:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280583680 00000100:00100000:1.0:1783969432.941022:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783969432.941029:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5796:x1870627280583680:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783969432.941096:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782fb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5796:x1870627280583680:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 68us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969432.941103:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783969432.941279:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac782fb1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5796:1870627280583680:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1783969432.941655:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1783969432.941723:0:5796:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac782fb1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5796:1870627280583808:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783969432.941752:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969432.941808:0:5796:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac787d34840 going to sleep for 11 seconds 00000100:00100000:1.0:1783969432.943085:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280583808 00000100:00100000:1.0:1783969432.943096:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280583808 00000100:00100000:1.0:1783969432.943222:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783969432.943231:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5796:x1870627280583808:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783969432.943440:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782fb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5796:x1870627280583808:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 211us (1687us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1783969432.943447:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783969432.943596:0:5796:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac782fb1880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5796:1870627280583808:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783969432.943651:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1783969432.943692:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab48e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.943703:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab48e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.943724:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab48e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.943731:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2044800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969432.943735:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab48e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.943743:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab48e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.943758:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:3.0:1783969432.943762:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1783969432.943765:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab48e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969432.943772:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab48e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783969432.944000:0:5796:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1783969432.944139:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1783969432.944148:0:5796:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 290026287703ns, next at 291026286154ns, rc = 0 00000001:00080000:3.0:1783969432.944154:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1783969432.944185:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:3.0:1783969432.944198:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783969432.944204:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab479 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63253 expref: 46 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969432.944303:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786072c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+45:10492:x1870627272180096:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 9468us (9739us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1783969432.944311:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 26 00000020:00080000:3.0:1783969432.944315:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1783969432.946382:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969432.946523:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272180352 00000100:00100000:2.0:1783969432.946531:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272180352 00000100:00100000:2.0:1783969432.946578:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 100 00000100:00100000:2.0:1783969432.946587:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+45:10492:x1870627272180352:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783969432.946606:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969432.946626:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab495 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6325a expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.946683:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab495 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6325a expref: 46 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.946725:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab495 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6325a expref: 46 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969432.946744:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:2.0:1783969432.946747:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783969432.946750:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c2045a00, rc 0) 00000100:00100000:2.0:1783969432.946801:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+46:10492:x1870627272180352:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 215us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969432.946808:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 100 00000100:00100000:0.0:1783969432.950184:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969432.950257:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272180608 00000100:00100000:3.0:1783969432.950265:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272180608 00000100:00100000:3.0:1783969432.950317:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 27 00000100:00100000:3.0:1783969432.950328:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+46:10492:x1870627272180608:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1783969432.950642:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+47:10492:x1870627272180608:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 315us (467us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1783969432.950650:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 27 00000100:00100000:0.0:1783969433.043315:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969433.043401:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272180736 00000100:00100000:2.0:1783969433.043410:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272180736 00000100:00100000:2.0:1783969433.043459:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 101 00000100:00100000:2.0:1783969433.043468:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+47:10502:x1870627272180736:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:2.0:1783969433.043540:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab49c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043557:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab49c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043568:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab49c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043584:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab4a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043591:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab4a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043619:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab4a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043714:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab4aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043723:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab4aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043730:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab4aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783969433.043770:0:10288:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab4aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043794:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab49c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043801:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab49c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043809:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab49c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043815:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2044c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969433.043819:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab49c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043825:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab49c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043835:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:2.0:1783969433.043844:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969433.043849:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab49c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043855:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab49c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043897:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab4a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043902:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab4a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043908:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab4a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043912:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2045200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969433.043915:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab4a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043921:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab4a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043929:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ac785336f00) 00010000:00010000:2.0:1783969433.043932:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969433.043935:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab4a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043940:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab4a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043954:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab4aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043967:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab4aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043973:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab4aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043978:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2044a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969433.043989:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab4aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.043996:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab4aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.044004:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:2.0:1783969433.044006:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969433.044009:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab4aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.044015:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab4aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969433.044091:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+47:10502:x1870627272180736:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 622us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969433.044099:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 101 00000100:00100000:2.0:1783969433.082974:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969433.083071:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272180992 00000100:00100000:0.0:1783969433.083080:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272180992 00000100:00100000:0.0:1783969433.083150:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 102 00000100:00100000:0.0:1783969433.083160:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782fb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+47:10505:x1870627272180992:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783969433.083181:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969433.083201:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab4b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63261 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.083271:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab4b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.083296:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab4b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.083308:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab4b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.083323:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.083331:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.083337:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.083470:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab4c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.083479:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.083486:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969433.083508:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783969433.083595:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab4b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.083602:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab4b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.083609:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab4b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.083616:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969433.083619:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab4b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.083627:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab4b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.083638:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:0.0:1783969433.083641:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969433.083646:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab4b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.083651:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab4b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.083663:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.083668:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.083684:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.083688:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969433.083691:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.083696:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.083705:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ac790086900) 00010000:00010000:0.0:1783969433.083706:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969433.083709:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.083713:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.083751:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab4b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63261 expref: 50 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.083763:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab4c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63261 expref: 49 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.083770:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:0.0:1783969433.083772:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969433.083787:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93800, rc 0) 00000100:00100000:0.0:1783969433.083847:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782fb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+49:10505:x1870627272180992:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 688us (881us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1783969433.083912:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 102 00000100:00100000:0.0:1783969433.087330:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969433.087416:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272181120 00000100:00100000:3.0:1783969433.087424:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272181120 00000100:00100000:3.0:1783969433.087478:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 103 00000100:00100000:3.0:1783969433.087488:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+49:10505:x1870627272181120:12345-192.168.203.39@tcp:54:lfs.0 00010000:00010000:3.0:1783969433.087545:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab4d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969433.087561:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab4d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969433.087572:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab4d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969433.087611:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab4d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969433.087617:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab4d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969433.087623:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab4d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969433.087629:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969433.087633:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab4d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969433.087640:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab4d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969433.087653:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:3.0:1783969433.087656:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783969433.087660:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab4d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969433.087666:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab4d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969433.087752:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+49:10505:x1870627272181120:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 264us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969433.087759:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 103 00000100:00100000:1.0:1783969433.091697:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969433.092058:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272181376 00000100:00100000:2.0:1783969433.092068:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272181376 00000100:00100000:2.0:1783969433.092124:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 28 00000100:00100000:2.0:1783969433.092134:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+49:10505:x1870627272181376:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1783969433.092555:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+50:10505:x1870627272181376:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 419us (865us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1783969433.092564:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 28 00010000:00010000:1.0:1783969433.125139:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969433.143268:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969433.143318:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969433.143480:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272181632 00000100:00100000:3.0:1783969433.143489:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272181632 00000100:00100000:3.0:1783969433.143563:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 127 00000100:00100000:3.0:1783969433.143586:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2348:x1870627272181632:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969433.143669:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2348:x1870627272181632:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 86us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969433.143677:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 127 00000100:00080000:1.0:1783969433.143715:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969433.143750:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272181504 00000100:00100000:2.0:1783969433.143754:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272181504 00000100:00100000:2.0:1783969433.143797:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 283 00000100:00100000:2.0:1783969433.143804:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2348:x1870627272181504:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783969433.143849:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2348:x1870627272181504:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 46us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969433.143856:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 283 00000100:00100000:0.0:1783969433.168721:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969433.168940:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272181888 00000100:00100000:2.0:1783969433.168949:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272181888 00000100:00100000:2.0:1783969433.169040:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 104 00000100:00100000:2.0:1783969433.169052:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+50:10515:x1870627272181888:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:2.0:1783969433.169075:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969433.169079:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783969433.169106:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab456 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63245 expref: 50 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.169125:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:2.0:1783969433.169130:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783969433.169144:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab4db lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63268 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.169239:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab4e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.169269:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab4c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63261 expref: 50 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.169277:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab4e2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.169322:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab4c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63261 expref: 50 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.169334:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab4c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63261 expref: 50 pid: 5793 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969433.169352:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac782fb2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5794:1870627280583936:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783969433.169655:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac78613e900 going to sleep for 11 seconds 00000100:00100000:2.0:1783969433.173393:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac782fb2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5794:1870627280583936:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969433.173420:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab4e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969433.173780:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969433.173927:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272182016 00000100:00100000:0.0:1783969433.173934:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272182016 00010000:00010000:0.0:1783969433.173969:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab4c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63261 expref: 51 pid: 5793 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969433.174010:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 52 00000100:00100000:0.0:1783969433.174020:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+51:2350:x1870627272182016:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969433.174189:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969433.174198:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab4c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63261 expref: 51 pid: 5793 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.174211:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab4c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63261 expref: 51 pid: 5793 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.174232:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab4c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63261 expref: 51 pid: 5793 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.174247:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:0.0:1783969433.174252:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab4e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.174262:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab4e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.174384:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab4e2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.174509:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969433.174570:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+50:2350:x1870627272182016:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 551us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969433.174578:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 52 00010000:00010000:2.0:1783969433.174620:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab4e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.174627:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab4e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969433.174644:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783969433.174800:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab4db lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63268 expref: 51 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.175488:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab4e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63268 expref: 50 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.175498:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:2.0:1783969433.175502:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783969433.175504:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c2045200, rc 0) 00000100:00100000:2.0:1783969433.175554:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+50:10515:x1870627272181888:12345-192.168.203.39@tcp:101:bash.0 Request processed in 6504us (6856us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1783969433.175562:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 104 00000100:00100000:1.0:1783969433.177927:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969433.177977:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272182272 00000100:00100000:2.0:1783969433.178001:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272182272 00000100:00100000:2.0:1783969433.178061:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 105 00000100:00100000:2.0:1783969433.178082:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+50:10515:x1870627272182272:12345-192.168.203.39@tcp:36:bash.0 00010000:00010000:2.0:1783969433.178324:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab4f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.178341:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab4f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.178352:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab4f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783969433.178411:0:10288:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:2.0:1783969433.178438:0:10288:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d9dac529 reply state 00000000d21c2c74 transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab4f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969433.178447:0:10288:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783969433.178543:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+53:10515:x1870627272182272:12345-192.168.203.39@tcp:36:bash.0 Request processed in 471us (623us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1783969433.178550:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 105 00000020:00080000:2.0:1783969433.178556:0:10288:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783969433.180595:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab4f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.180608:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab4f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.180615:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab4f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.180621:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2044c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969433.180626:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab4f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.180633:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab4f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.180647:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:0.0:1783969433.180650:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969433.180655:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab4f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.180660:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab4f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969433.181709:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969433.182096:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272182400 00000100:00100000:0.0:1783969433.182104:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272182400 00000100:00100000:0.0:1783969433.182162:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 106 00000100:00100000:0.0:1783969433.182172:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+52:10515:x1870627272182400:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:0.0:1783969433.182209:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969433.182228:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab4f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6326f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.182464:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.182481:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab4e2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63268 expref: 53 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.182490:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4fe lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.182524:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab4e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63268 expref: 53 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.182539:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab4e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63268 expref: 53 pid: 5794 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969433.182552:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac787782a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1870627280584064:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783969433.182621:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7860b0600 going to sleep for 11 seconds 00000100:00100000:0.0:1783969433.190685:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac787782a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1870627280584064:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783969433.190716:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969433.201656:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969433.201794:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272182528 00000100:00100000:3.0:1783969433.201803:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272182528 00010000:00010000:3.0:1783969433.201844:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab4e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63268 expref: 54 pid: 5794 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969433.205695:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 53 00000100:00100000:0.0:1783969433.205720:0:8304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+54:2350:x1870627272182528:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969433.205742:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969433.205755:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab4e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63268 expref: 54 pid: 5794 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.205771:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab4e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63268 expref: 54 pid: 5794 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.205794:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab4e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63268 expref: 54 pid: 5794 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.205812:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:0.0:1783969433.205817:0:8304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.205826:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.205833:0:8304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4fe lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.205903:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969433.205962:0:8304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+53:2350:x1870627272182528:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 255us (4316us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969433.205971:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 53 00010000:00010000:1.0:1783969433.207314:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969433.207327:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969433.207371:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1783969433.207375:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783969433.207400:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969433.207434:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab4f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6326f expref: 53 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969433.207475:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6326f expref: 52 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969433.207488:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:1.0:1783969433.207491:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783969433.207494:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93c00, rc 0) 00000100:00100000:1.0:1783969433.207554:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+52:10515:x1870627272182400:12345-192.168.203.39@tcp:101:bash.0 Request processed in 25383us (25849us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969433.207562:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 106 00000100:00100000:1.0:1783969433.219428:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969433.219611:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272182784 00000100:00100000:3.0:1783969433.219621:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272182784 00000100:00100000:3.0:1783969433.219679:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 29 00000100:00100000:3.0:1783969433.219690:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+52:10515:x1870627272182784:12345-192.168.203.39@tcp:35:bash.0 00000100:00100000:0.0:1783969433.221258:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+53:10515:x1870627272182784:12345-192.168.203.39@tcp:35:bash.0 Request processed in 1564us (1834us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1783969433.221282:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 29 00000100:00100000:2.0:1783969433.310016:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969433.310297:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272182912 00000100:00100000:0.0:1783969433.310307:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272182912 00000100:00100000:0.0:1783969433.310371:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 107 00000100:00100000:0.0:1783969433.310382:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+53:10521:x1870627272182912:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783969433.310406:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969433.310426:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab505 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63276 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.310495:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab50c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.310510:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab50c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.310521:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab50c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969433.311007:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1783969433.311013:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783969433.311038:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab50c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.311066:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab505 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63276 expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.311085:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab50c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63276 expref: 54 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.311112:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:0.0:1783969433.311115:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783969433.311119:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92400, rc 0) 00000100:00100000:0.0:1783969433.311174:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782fb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+54:10521:x1870627272182912:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 793us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969433.311181:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 107 00000100:00100000:1.0:1783969433.316776:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969433.317389:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272183040 00000100:00100000:2.0:1783969433.317399:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272183040 00000100:00100000:2.0:1783969433.317465:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 108 00000100:00100000:2.0:1783969433.317475:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+54:10521:x1870627272183040:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783969433.317494:0:10288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969433.317513:0:10288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab513 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6327d expref: -99 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.317586:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab51a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.317601:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab51a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.317614:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab51a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.317630:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab521 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.317638:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab521 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.317645:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab521 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.317761:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab528 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.317770:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab528 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.317790:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab528 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969433.317825:0:10288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783969433.317830:0:10288:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783969433.317849:0:10288:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab528 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.317881:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab528 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.317890:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab51a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.317897:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab51a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.317904:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab51a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.317910:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2045400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969433.317914:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab51a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.317921:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab51a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.317941:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:2.0:1783969433.317944:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969433.317949:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab51a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.317954:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab51a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.317967:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab521 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.317973:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab521 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.317989:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab521 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.317996:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2045200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969433.317999:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab521 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.318006:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab521 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.318013:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ac785336f00) 00010000:00010000:2.0:1783969433.318015:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969433.318017:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab521 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.318023:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab521 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.318065:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab513 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6327d expref: 56 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.318080:0:10288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab528 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6327d expref: 55 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.318087:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:2.0:1783969433.318089:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783969433.318092:0:10288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c2044a00, rc 0) 00000100:00100000:2.0:1783969433.318158:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+55:10521:x1870627272183040:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 684us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969433.318165:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 108 00000100:00100000:1.0:1783969433.328662:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969433.328743:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969433.329010:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272183296 00000100:00100000:0.0:1783969433.329020:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272183296 00000100:00100000:0.0:1783969433.329078:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 109 00000100:00100000:0.0:1783969433.329088:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+55:10521:x1870627272183296:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783969433.329107:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969433.329128:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab52f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63284 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.329223:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab536 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.329239:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6326f expref: 56 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.329248:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab528 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6327d expref: 56 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.329256:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab536 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.329302:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab528 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6327d expref: 56 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.329325:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab528 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6327d expref: 56 pid: 10288 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969433.329340:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac787782a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1870627280584192:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783969433.329450:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6326f expref: 56 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.329461:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6326f expref: 56 pid: 5793 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969433.329471:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac787780a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1870627280584320:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783969433.329495:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7860b0600 going to sleep for 11 seconds 00000100:00100000:2.0:1783969433.330587:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272183424 00000100:00100000:2.0:1783969433.330597:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272183424 00010000:00010000:2.0:1783969433.330628:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab528 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6327d expref: 57 pid: 10288 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969433.330903:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 54 00000100:00100000:2.0:1783969433.330914:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+57:2348:x1870627272183424:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969433.330926:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969433.330933:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab528 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6327d expref: 57 pid: 10288 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.330947:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab528 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6327d expref: 57 pid: 10288 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.330994:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:2.0:1783969433.331000:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab536 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.331009:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab536 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.331016:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969433.331107:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+57:2348:x1870627272183424:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 195us (2363us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969433.331116:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 54 00010000:00010000:1.0:1783969433.338046:0:5793:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.39@tcp) returned -22 from blocking AST (req@00000000eb0ae993 x1870627280584192) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab528 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6327d expref: 56 pid: 10288 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969433.338073:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab528 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6327d expref: 56 pid: 10288 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969433.338092:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac787782a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1870627280584192:192.168.203.39@tcp:104: 00000100:00100000:1.0:1783969433.338107:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac787780a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1870627280584320:192.168.203.39@tcp:104: 00010000:00010000:1.0:1783969433.338130:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:1.0:1783969433.338136:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab536 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969433.338164:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab536 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969433.338174:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab536 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969433.340639:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969433.340792:0:8304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272183552 00000100:00100000:0.0:1783969433.340802:0:8304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272183552 00010000:00010000:0.0:1783969433.340842:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6326f expref: 56 pid: 5793 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969433.340910:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 55 00000100:00100000:0.0:1783969433.340920:0:8304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a62450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+56:2350:x1870627272183552:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969433.340934:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969433.340941:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6326f expref: 56 pid: 5793 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.340955:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6326f expref: 56 pid: 5793 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.341004:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab4fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6326f expref: 56 pid: 5793 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.341019:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:0.0:1783969433.341023:0:8304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab536 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.341032:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab536 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.341039:0:8304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab536 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969433.341063:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969433.341120:0:8304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a62450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+55:2350:x1870627272183552:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 201us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969433.341127:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 55 00010000:00010000:1.0:1783969433.342083:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab536 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969433.342096:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab536 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969433.342114:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1783969433.342260:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab52f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63284 expref: 56 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969433.342279:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab536 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63284 expref: 55 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969433.342300:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:1.0:1783969433.342303:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783969433.342306:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92600, rc 0) 00000100:00100000:1.0:1783969433.342359:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+55:10521:x1870627272183296:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 13271us (13714us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1783969433.342367:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 109 00000100:00100000:1.0:1783969433.349121:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969433.349316:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272183808 00000100:00100000:2.0:1783969433.349326:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272183808 00000100:00100000:2.0:1783969433.349388:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:2.0:1783969433.349398:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+55:10521:x1870627272183808:12345-192.168.203.39@tcp:103:lfs.0 00010000:00010000:2.0:1783969433.349413:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969433.349437:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab495 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6325a expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.349457:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:2.0:1783969433.349462:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969433.349517:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+54:10521:x1870627272183808:12345-192.168.203.39@tcp:103:lfs.0 Request processed in 121us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969433.349525:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:0.0:1783969433.352925:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969433.353026:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272183936 00000100:00100000:2.0:1783969433.353036:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272183936 00000100:00100000:2.0:1783969433.353107:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 110 00000100:00100000:2.0:1783969433.353116:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+54:10521:x1870627272183936:12345-192.168.203.39@tcp:58:lfs.0 00010000:00010000:2.0:1783969433.353208:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab544 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.353225:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab544 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969433.353237:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab544 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783969433.353460:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1783969433.353542:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+54:10521:x1870627272183936:12345-192.168.203.39@tcp:58:lfs.0 Request processed in 427us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969433.353550:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 110 00000100:00100000:3.0:1783969433.358200:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969433.358317:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272184064 00000100:00100000:1.0:1783969433.358342:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272184064 00000100:00100000:1.0:1783969433.358399:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 111 00000100:00100000:1.0:1783969433.358409:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+54:10521:x1870627272184064:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1783969433.358428:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969433.358448:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076fab54b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6328b expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969433.358502:0:6618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab544 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969433.358513:0:6618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076fab54b lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6328b expref: 55 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969433.358532:0:6618:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab544 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969433.358544:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076fab54b lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6328b expref: 55 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969433.358568:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:1.0:1783969433.358572:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783969433.358576:0:6618:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076fab54b lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6328b expref: 55 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969433.358583:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bf60e800, rc 0) 00000100:00100000:1.0:1783969433.358641:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+55:10521:x1870627272184064:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 233us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969433.358655:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 111 00010000:00010000:1.0:1783969434.149094:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783969434.149117:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783969434.149124:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783969434.149162:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1783969434.149168:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783969434.149292:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac787782a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1870627280584448:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783969434.149397:0:11535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7860b0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969434.153387:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969434.153519:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac787782a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1870627280584448:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783969434.153897:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272184192 00000100:00100000:1.0:1783969434.153906:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272184192 00000100:00100000:1.0:1783969434.153989:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 112 00000100:00100000:1.0:1783969434.154000:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+55:10523:x1870627272184192:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783969434.154032:0:5793:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783969434.154136:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+55:10523:x1870627272184192:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 Request processed in 137us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969434.154143:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 112 00000100:00080000:2.0:1783969434.154211:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969434.162437:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969434.162651:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272184320 00000100:00100000:3.0:1783969434.162662:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272184320 00000100:00100000:3.0:1783969434.162738:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 113 00000100:00100000:3.0:1783969434.162748:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+55:10523:x1870627272184320:12345-192.168.203.39@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783969434.162826:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab552 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.162842:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab552 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.162853:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab552 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.162938:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab559 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.162961:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab559 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.162969:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab559 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.163003:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab560 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.163012:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.163019:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969434.163056:0:10288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1783969434.163065:0:10288:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783969434.163077:0:10288:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.163087:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab552 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.163093:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab552 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.163099:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab552 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.163105:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969434.163109:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab552 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.163124:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab552 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.163136:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac790086e00) 00010000:00010000:3.0:1783969434.163139:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969434.163144:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab552 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.163151:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab552 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.163164:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab559 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.163171:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab559 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.163176:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab559 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.163181:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de7800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969434.163183:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab559 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.163189:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab559 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.163196:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9ac78c550200) 00010000:00010000:3.0:1783969434.163199:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969434.163202:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab559 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.163216:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab559 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.163231:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab560 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.163237:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab560 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.163243:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab560 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.163248:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969434.163251:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab560 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.163256:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab560 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.163264:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:3.0:1783969434.163266:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969434.163269:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab560 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.163275:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab560 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969434.163362:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+55:10523:x1870627272184320:12345-192.168.203.39@tcp:34:lhsmtool_posix.0 Request processed in 615us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969434.163371:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 113 00000100:00100000:3.0:1783969434.166035:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969434.166132:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272184576 00000100:00100000:2.0:1783969434.166141:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272184576 00000100:00100000:2.0:1783969434.166205:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 114 00000100:00100000:2.0:1783969434.166216:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+55:10523:x1870627272184576:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783969434.166238:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969434.166257:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab567 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63292 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.166349:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab56e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.166364:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab56e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.166389:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab56e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969434.166402:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783969434.166496:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab56e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.166504:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab56e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.166511:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab56e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.166517:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2045200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969434.166521:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab56e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.166528:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab56e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.166540:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:2.0:1783969434.166543:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783969434.166547:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab56e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.166553:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab56e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.167036:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab567 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63292 expref: 57 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.167063:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac790086e00) 00010000:00010000:2.0:1783969434.167065:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783969434.167070:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab567 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63292 expref: 57 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.167081:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c2045a00, rc 0) 00000100:00100000:2.0:1783969434.167235:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+56:10523:x1870627272184576:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 1019us (1205us total) trans 4294967398 rc 301/301 00000100:00100000:2.0:1783969434.167243:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 114 00000100:00100000:0.0:1783969434.178203:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969434.179104:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272184704 00000100:00100000:2.0:1783969434.179116:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272184704 00000100:00100000:2.0:1783969434.180009:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 115 00000100:00100000:2.0:1783969434.180024:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+56:10523:x1870627272184704:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783969434.180062:0:5794:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783969434.180194:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+56:10523:x1870627272184704:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 Request processed in 173us (1999us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969434.180203:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 115 00000100:00100000:1.0:1783969434.186038:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969434.186125:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272184960 00000100:00100000:3.0:1783969434.186134:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272184960 00000100:00100000:3.0:1783969434.186190:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 116 00000100:00100000:3.0:1783969434.186200:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+56:10523:x1870627272184960:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969434.187729:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969434.187732:0:6618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783969434.187762:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab50c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63276 expref: 56 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.187913:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:3.0:1783969434.187918:0:6618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783969434.187935:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab57c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63299 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783969434.190090:0:6618:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1783969434.192711:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab583 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.192733:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.192745:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.192814:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab57c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63299 expref: 58 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.192849:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab583 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63299 expref: 57 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.192878:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ac785336f00) 00010000:00010000:2.0:1783969434.192881:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783969434.192885:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c2045a00, rc 0) 00000100:00100000:2.0:1783969434.192962:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+57:10523:x1870627272184960:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 6762us (6932us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1783969434.192971:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 116 00000100:00100000:0.0:1783969434.203370:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969434.203520:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272185216 00000100:00100000:2.0:1783969434.203531:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272185216 00000100:00100000:2.0:1783969434.203587:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 117 00000100:00100000:2.0:1783969434.203599:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+57:10523:x1870627272185216:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783969434.203656:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969434.203684:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab583 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63299 expref: 57 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.203704:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ac785336f00) 00010000:00010000:2.0:1783969434.203732:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783969434.203754:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab591 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.203778:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab591 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.203789:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab591 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.203811:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab598 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x6cf129ec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.203819:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab598 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6cf129ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.203826:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab598 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6cf129ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.203942:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab591 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.203951:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab591 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.203958:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab591 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.203964:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2045200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969434.203969:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab591 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.203986:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab591 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.203995:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:2.0:1783969434.203998:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969434.204001:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab591 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.204007:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab591 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.204024:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab598 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6cf129ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.204031:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab598 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6cf129ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.204037:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab598 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6cf129ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.204042:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2045400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969434.204045:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab598 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6cf129ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.204050:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab598 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6cf129ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.204058:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x6cf129ec (ffff9ac785336c00) 00010000:00010000:2.0:1783969434.204061:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969434.204064:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab598 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6cf129ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.204070:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab598 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6cf129ec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969434.204155:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1beb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+56:10523:x1870627272185216:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 558us (794us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783969434.204162:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 117 00000100:00100000:0.0:1783969434.210354:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969434.210489:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272185344 00000100:00100000:2.0:1783969434.210498:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272185344 00000100:00100000:2.0:1783969434.210595:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 118 00000100:00100000:2.0:1783969434.210619:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+56:10523:x1870627272185344:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783969434.210638:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969434.210660:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab59f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb632a0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.210695:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab5a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.210707:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.210718:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.210813:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab59f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632a0 expref: 58 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.210832:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632a0 expref: 57 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.210839:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ac785336f00) 00010000:00010000:2.0:1783969434.210842:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783969434.210845:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c2044c00, rc 0) 00000100:00100000:2.0:1783969434.210920:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+57:10523:x1870627272185344:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 304us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969434.210927:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 118 00000100:00100000:1.0:1783969434.222692:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969434.224193:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272185600 00000100:00100000:2.0:1783969434.224207:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272185600 00000100:00100000:2.0:1783969434.224338:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 119 00000100:00100000:2.0:1783969434.224364:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+57:10523:x1870627272185600:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783969434.224563:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab5ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.224582:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab5ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.224594:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab5ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783969434.224849:0:6618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1783969434.224892:0:6618:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 291307031722ns, next at 292306996214ns, rc = 0 00000004:00010000:2.0:1783969434.224995:0:6618:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c1fc72a6 reply state 000000006f136412 transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab5ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969434.225005:0:6618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783969434.225203:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+59:10523:x1870627272185600:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 841us (2519us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1783969434.225211:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 119 00010000:00010000:2.0:1783969434.230359:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab5ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.230377:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab5ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.230385:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab5ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.230392:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2045a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969434.230397:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab5ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.230420:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab5ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.230509:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ac785336f00) 00010000:00010000:2.0:1783969434.230512:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783969434.230517:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab5ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.230524:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab5ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969434.240674:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969434.241212:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272185728 00000100:00100000:2.0:1783969434.241224:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272185728 00000100:00100000:2.0:1783969434.241319:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 120 00000100:00100000:2.0:1783969434.241330:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+58:10523:x1870627272185728:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783969434.241354:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969434.241372:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab5b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb632a7 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.241444:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab5b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632a7 expref: 59 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.241461:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab5b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632a7 expref: 59 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.241481:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ac785336f00) 00010000:00010000:2.0:1783969434.241484:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783969434.241488:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c2045a00, rc 0) 00000100:00100000:2.0:1783969434.241568:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+59:10523:x1870627272185728:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 239us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969434.241575:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 120 00000100:00100000:0.0:1783969434.248037:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969434.248117:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272185856 00000100:00100000:3.0:1783969434.248127:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272185856 00000100:00100000:3.0:1783969434.248200:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 37 00000100:00100000:3.0:1783969434.248211:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+8:2350:x1870627272185856:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1783969434.248232:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969434.248490:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+9:2350:x1870627272185856:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 Request processed in 282us (461us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1783969434.248498:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 37 00000100:00100000:0.0:1783969434.254192:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969434.254267:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272186112 00000100:00100000:2.0:1783969434.254277:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272186112 00000100:00100000:2.0:1783969434.254334:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 30 00000100:00100000:2.0:1783969434.254344:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+59:10523:x1870627272186112:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783969434.254576:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+60:10523:x1870627272186112:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 232us (392us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1783969434.254585:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 30 00000100:00100000:3.0:1783969434.261405:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969434.262793:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272186368 00000100:00100000:2.0:1783969434.262806:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272186368 00000100:00100000:2.0:1783969434.262915:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 121 00000100:00100000:2.0:1783969434.262927:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+60:10523:x1870627272186368:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783969434.263060:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+60:10523:x1870627272186368:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 134us (1661us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969434.263079:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 121 00000100:00100000:3.0:1783969434.272572:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969434.272714:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272186496 00000100:00100000:2.0:1783969434.272723:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272186496 00000100:00100000:2.0:1783969434.272781:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 122 00000100:00100000:2.0:1783969434.272790:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+60:10523:x1870627272186496:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783969434.272809:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969434.272830:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab5bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb632ae expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.272923:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab5c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.272948:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.272960:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969434.273008:0:6618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783969434.273026:0:6618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab5c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.273051:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab5bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632ae expref: 62 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.273230:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab5c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632ae expref: 61 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.273240:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ac785336f00) 00010000:00010000:2.0:1783969434.273243:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783969434.273246:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c2045200, rc 0) 00000100:00100000:2.0:1783969434.273305:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+61:10523:x1870627272186496:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 515us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969434.273312:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 122 00000100:00100000:1.0:1783969434.275577:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969434.275663:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272186624 00000100:00100000:0.0:1783969434.275672:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272186624 00000100:00100000:0.0:1783969434.275722:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 38 00000100:00100000:0.0:1783969434.275732:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+9:2351:x1870627272186624:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783969434.275747:0:6594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969434.275765:0:6594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fab5c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb632b5 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783969434.275791:0:6594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a55369a, blocks: 0x1 00010000:00010000:0.0:1783969434.275808:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=291s v=(0 0) 00010000:00010000:0.0:1783969434.275812:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969434.275822:0:6594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fab5c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632b5 expref: 10 pid: 6594 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.275838:0:6594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fab5c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632b5 expref: 10 pid: 6594 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.275851:0:6594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93c00, rc 0) 00000100:00100000:0.0:1783969434.275934:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+10:2351:x1870627272186624:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 203us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969434.275941:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 38 00000100:00100000:3.0:1783969434.281727:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969434.282165:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272186880 00000100:00100000:2.0:1783969434.282175:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272186880 00000100:00100000:2.0:1783969434.282264:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 123 00000100:00100000:2.0:1783969434.282274:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+61:10523:x1870627272186880:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783969434.282378:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+61:10523:x1870627272186880:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 105us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969434.282399:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 123 00000100:00100000:3.0:1783969434.288173:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969434.288263:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272187008 00000100:00100000:1.0:1783969434.288273:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272187008 00000100:00100000:1.0:1783969434.288332:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 39 00000100:00100000:1.0:1783969434.288342:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+10:10523:x1870627272187008:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783969434.288358:0:6595:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969434.288374:0:6595:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af722a59/0xbacf56d076fab5d0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb632bc expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969434.288404:0:6595:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fab5c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632b5 expref: 11 pid: 6594 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969434.288413:0:6595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969434.288417:0:6595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969434.288546:0:6595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af722a59/0xbacf56d076fab5d0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632bc expref: 11 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969434.288581:0:6595:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fab5c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632b5 expref: 11 pid: 6594 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969434.288595:0:6595:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fab5c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632b5 expref: 11 pid: 6594 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969434.288610:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7981bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6595:1870627280584576:192.168.203.39@tcp:104: 00000100:00100000:1.0:1783969434.288705:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7c18e2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783969434.291365:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969434.291473:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7981bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6595:1870627280584576:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783969434.291505:0:6595:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000af722a59/0xbacf56d076fab5d0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632bc expref: 11 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.291525:0:6595:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bf60e600, rc 0) 00000100:00100000:3.0:1783969434.291578:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+11:10523:x1870627272187008:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 3237us (3415us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969434.291587:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 39 00000100:00100000:0.0:1783969434.291711:0:8304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272187136 00000100:00100000:0.0:1783969434.291718:0:8304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272187136 00010000:00010000:0.0:1783969434.291759:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fab5c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632b5 expref: 11 pid: 6594 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969434.291805:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 56 00000100:00100000:0.0:1783969434.291814:0:8304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+11:2350:x1870627272187136:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969434.291826:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969434.291847:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fab5c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632b5 expref: 11 pid: 6594 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.291896:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fab5c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632b5 expref: 11 pid: 6594 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.291919:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fab5c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632b5 expref: 11 pid: 6594 timeout: 391 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.291933:0:8304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969434.291937:0:8304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969434.291945:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000af722a59/0xbacf56d076fab5d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632bc expref: 10 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.291955:0:8304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af722a59/0xbacf56d076fab5d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632bc expref: 10 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.291999:0:8304:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000af722a59/0xbacf56d076fab5d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632bc expref: 10 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969434.292027:0:8304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a787d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8304:1870627280584704:192.168.203.39@tcp:105: 00000100:00100000:0.0:1783969434.292182:0:8304:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7860b0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783969434.297353:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969434.297472:0:8304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a787d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8304:1870627280584704:192.168.203.39@tcp:105: 00010000:00010000:0.0:1783969434.297493:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969434.297552:0:8304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+10:2350:x1870627272187136:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 5738us (6195us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969434.297564:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 56 00000100:00100000:2.0:1783969434.301363:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272187264 00000100:00100000:2.0:1783969434.301378:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272187264 00002000:00100000:2.0:1783969434.301490:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9ac7981bf480 x1870627272187264/t0(0) o4->03985e57-ffb4-414b-b30c-e72697857d4f@192.168.203.39@tcp:330/0 lens 504/0 e 0 to 0 dl 1783969445 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783969434.301502:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac7981bf480 with x1870627272187264 ext(0->12) 00002000:00010000:2.0:1783969434.301509:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ac7981bf480 00000100:00100000:2.0:1783969434.301576:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00100000:2.0:1783969434.301587:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:03985e57-ffb4-414b-b30c-e72697857d4f+10:2351:x1870627272187264:12345-192.168.203.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783969434.302295:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:03985e57-ffb4-414b-b30c-e72697857d4f+12:2351:x1870627272187264:12345-192.168.203.39@tcp:4:lhsmtool_posix.0 Request processed in 708us (4948us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1783969434.302305:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2 00002000:00100000:2.0:1783969434.302313:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9ac7981bf480 x1870627272187264/t4294967308(0) o4->03985e57-ffb4-414b-b30c-e72697857d4f@192.168.203.39@tcp:330/0 lens 504/448 e 0 to 0 dl 1783969445 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783969434.302322:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac7981bf480 with x1870627272187264 ext(0->12) 00002000:00010000:2.0:1783969434.302327:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ac7981bf480 00000100:00100000:1.0:1783969434.310342:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969434.310530:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272187392 00000100:00100000:3.0:1783969434.310539:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272187392 00000100:00100000:3.0:1783969434.310629:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 124 00000100:00100000:3.0:1783969434.310640:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+61:10523:x1870627272187392:12345-192.168.203.39@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1783969434.348921:0:11828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967391 is committed 00000004:00080000:0.0:1783969434.348938:0:11828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:0.0:1783969434.348989:0:11828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000001:00080000:0.0:1783969434.349006:0:11828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000004:00080000:0.0:1783969434.349011:0:11828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1783969434.349029:0:11828:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ac787d34b40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1783969434.349034:0:11828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ac7860c9c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ac798c55840 00000020:00080000:0.0:1783969434.349038:0:11828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ac7860c9e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ac790baac00 00000020:00080000:0.0:1783969434.349080:0:11828:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ac7bfa45b40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1783969434.349084:0:11828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ac7860c9d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ac7bfa45cc0 00000020:00080000:0.0:1783969434.349087:0:11828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ac7860c9500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ac7ba17d000 00000004:00080000:0.0:1783969434.349099:0:11828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1783969434.349125:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1783969434.349311:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1783969434.349411:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a787d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280584832:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783969434.349635:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969434.349698:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280584832 00000100:00100000:0.0:1783969434.349705:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280584832 00000100:00100000:0.0:1783969434.349752:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783969434.349760:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3288:x1870627280584832:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783969434.349784:0:6594:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1783969434.349812:0:6594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a553698, atime: 0x6a553698, ctime: 0x6a553698, blocks: 0x1 00010000:00010000:0.0:1783969434.349820:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fab5d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.349837:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=291s v=(0 0) 00010000:00010000:0.0:1783969434.349842:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969434.349849:0:6594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fab5d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.349894:0:6594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fab5d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.349905:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fab5d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.349913:0:6594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fab5d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.349931:0:6594:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783969434.350574:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3288:x1870627280584832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 811us (937us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1783969434.350583:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1783969434.350618:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969434.350624:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fab5d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.350633:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93c00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969434.350637:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fab5d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.350646:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fab5d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.350662:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fab5d7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.350670:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fab5d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.350687:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969434.350689:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969434.350690:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783969434.350698:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1783969434.350730:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ac7a787d500/2, rc 0, transno 4294967304 00000100:00100000:0.0:1783969434.350735:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a787d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280584832:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783969434.350909:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+15:10523:x1870627272187392:12345-192.168.203.39@tcp:44:lhsmtool_posix.0 Request processed in 40267us (40572us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969434.350917:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 124 00000100:00100000:2.0:1783969434.351615:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac782fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280585088:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783969434.351656:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969434.351686:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783969434.351692:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac782fb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280584960:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783969434.351710:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969434.351962:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280585088 00000100:00100000:2.0:1783969434.351968:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280585088 00000100:00100000:2.0:1783969434.352023:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280584960 00000100:00100000:2.0:1783969434.352037:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280584960 00000100:00100000:2.0:1783969434.352056:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783969434.352073:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3286:x1870627280585088:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1783969434.352202:0:6593:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1783969434.352206:0:6593:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783969434 00002000:00010000:2.0:1783969434.352209:0:6593:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783969434.352211:0:6593:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1783969434 -> 1783969434 00002000:00010000:2.0:1783969434.352214:0:6593:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1783969434.352250:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3286:x1870627280585088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 186us (592us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1783969434.352257:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783969434.352271:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783969434.352278:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3286:x1870627280584960:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783969434.352302:0:6593:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1783969434.352319:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf749bed/0xbacf56d076fab5de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.352339:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fab399 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6321b expref: 11 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.352348:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1783969434.352352:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783969434.352357:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf749bed/0xbacf56d076fab5de lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.352383:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fab399 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6321b expref: 11 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.352411:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fab399 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6321b expref: 11 pid: 6593 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969434.352587:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac782fb3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6593:1870627280585216:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783969434.352642:0:6593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac787d34cc0 going to sleep for 11 seconds 00000004:00080000:2.0:1783969434.352673:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ac782fb2a00/2, rc 0, transno 4294967309 00000100:00100000:2.0:1783969434.352679:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac782fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280585088:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1783969434.352740:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969434.361376:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969434.362548:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272187520 00000100:00100000:3.0:1783969434.362560:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272187520 00010000:00010000:3.0:1783969434.362605:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fab399 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6321b expref: 12 pid: 6593 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969434.362654:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 57 00000100:00100000:3.0:1783969434.362665:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+12:2350:x1870627272187520:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969434.362679:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969434.362684:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fab399 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6321b expref: 12 pid: 6593 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.362715:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fab399 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6321b expref: 12 pid: 6593 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.362741:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783969434.362745:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783969434.362752:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cf749bed/0xbacf56d076fab5de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.362761:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf749bed/0xbacf56d076fab5de lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.362782:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969434.362848:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+12:2350:x1870627272187520:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 184us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969434.362855:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 57 00010000:00010000:2.0:1783969434.365165:0:6593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fab399 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6321b expref: 11 pid: 6593 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969434.365188:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac782fb3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6593:1870627280585216:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969434.365211:0:6593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cf749bed/0xbacf56d076fab5de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.368002:0:6593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cf749bed/0xbacf56d076fab5de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.368022:0:6593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf749bed/0xbacf56d076fab5de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.368033:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf749bed/0xbacf56d076fab5de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.368040:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf749bed/0xbacf56d076fab5de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.368196:0:6593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783969434.370572:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969434.370657:0:9934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272187648 00000100:00100000:0.0:1783969434.370665:0:9934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272187648 00000100:00100000:0.0:1783969434.370718:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 43 00000100:00100000:0.0:1783969434.370727:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+11:2350:x1870627272187648:12345-192.168.203.39@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1783969434.371362:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782fb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3286:x1870627280584960:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19082us (19648us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1783969434.371372:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1783969434.376375:0:8303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969434.376389:0:8303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf749bed/0xbacf56d076fab5de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969434.376404:0:8303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2045400 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969434.376409:0:8303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf749bed/0xbacf56d076fab5de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969434.376421:0:8303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf749bed/0xbacf56d076fab5de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969434.377621:0:8303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf749bed/0xbacf56d076fab5de lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969434.377643:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf749bed/0xbacf56d076fab5de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969434.377680:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969434.377682:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969434.377684:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783969434.378016:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ac782fb0700/2, rc 0, transno 4294967310 00000100:00100000:2.0:1783969434.378026:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac782fb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280584960:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1783969434.422366:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1783969434.422385:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1783969434.422389:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:3.0:1783969434.422400:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:2.0:1783969434.422640:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba269450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+6:2350:x1870627272187648:12345-192.168.203.39@tcp:16:lhsmtool_posix.0 Request processed in 51908us (52069us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969434.422652:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 43 00000100:00100000:1.0:1783969434.426643:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969434.431794:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272187904 00000100:00100000:2.0:1783969434.431810:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272187904 00000100:00100000:0.0:1783969434.432031:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 125 00000100:00100000:0.0:1783969434.432044:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+15:10523:x1870627272187904:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783969434.432167:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969434.432193:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab5c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632ae expref: 15 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.432214:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ac785336f00) 00010000:00010000:0.0:1783969434.432219:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783969434.432247:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab5e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.432261:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab5e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.432271:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab5e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783969434.432487:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000029aeabc2 reply state 00000000b89df388 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab5e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969434.432496:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783969434.432596:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+16:10523:x1870627272187904:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 555us (5962us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1783969434.432604:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 125 00010000:00010000:0.0:1783969434.435572:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab5e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.435591:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab5e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.435616:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab5e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.435622:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969434.435627:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab5e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.435635:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab5e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.435651:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ac785336f00) 00010000:00010000:0.0:1783969434.435655:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969434.435659:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab5e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.435665:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab5e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969434.440587:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969434.440669:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272188032 00000100:00100000:3.0:1783969434.440678:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272188032 00000100:00100000:3.0:1783969434.440737:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 44 00000100:00100000:3.0:1783969434.440748:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+6:2350:x1870627272188032:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783969434.441310:0:6595:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1783969434.441315:0:6595:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1783969434 -> 1783969433 00002000:00010000:3.0:1783969434.441317:0:6595:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783969432 00002000:00010000:3.0:1783969434.441319:0:6595:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1783969434 -> 1783969433 00002000:00010000:3.0:1783969434.441322:0:6595:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1783969434.443098:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+7:2350:x1870627272188032:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 Request processed in 2341us (2509us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1783969434.443112:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 44 00000100:00100000:3.0:1783969434.449947:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969434.450088:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272188288 00000100:00100000:2.0:1783969434.450108:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272188288 00000100:00100000:2.0:1783969434.450163:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 126 00000100:00100000:2.0:1783969434.450173:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+15:10523:x1870627272188288:12345-192.168.203.39@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1783969434.450235:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab5ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.450252:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab5a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632a0 expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.450262:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab5ec lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.450293:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632a0 expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.450308:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab5a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632a0 expref: 15 pid: 5794 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969434.450322:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac782fb3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1870627280585344:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783969434.450395:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac787d34e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783969434.457722:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969434.457803:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272188416 00000100:00100000:1.0:1783969434.457812:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272188416 00010000:00010000:1.0:1783969434.457850:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab5a6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632a0 expref: 16 pid: 5794 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969434.457958:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 58 00000100:00100000:1.0:1783969434.457968:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7962300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03985e57-ffb4-414b-b30c-e72697857d4f+16:2351:x1870627272188416:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969434.457998:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969434.458006:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab5a6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632a0 expref: 16 pid: 5794 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969434.458019:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab5a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632a0 expref: 16 pid: 5794 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969434.458040:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ac785336f00) 00010000:00010000:1.0:1783969434.458045:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab5ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969434.458082:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab5ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969434.458089:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab5ec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969434.458109:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969434.458164:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7962300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03985e57-ffb4-414b-b30c-e72697857d4f+16:2351:x1870627272188416:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 197us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969434.458173:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 58 00010000:00010000:2.0:1783969434.458471:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab5a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632a0 expref: 15 pid: 5794 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969434.458488:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac782fb3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1870627280585344:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969434.458505:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab5ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.458513:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab5ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.458525:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab5ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.458550:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab5ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.458557:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab5ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.458563:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab5ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.458569:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2045200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969434.458574:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab5ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.458581:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab5ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.458591:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ac785336f00) 00010000:00010000:2.0:1783969434.458594:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1783969434.458596:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab5ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.458602:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab5ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969434.458658:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7961500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+14:10523:x1870627272188288:12345-192.168.203.39@tcp:55:lhsmtool_posix.0 Request processed in 8486us (8720us total) trans 0 rc -22/-22 00000100:00100000:2.0:1783969434.458666:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 126 00000100:00100000:3.0:1783969434.466917:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969434.466968:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272188544 00000100:00100000:0.0:1783969434.466992:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272188544 00000100:00100000:0.0:1783969434.467054:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 45 00000100:00100000:0.0:1783969434.467131:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+7:2351:x1870627272188544:12345-192.168.203.39@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1783969434.467176:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000058d86b44/0xbacf56d076fab5f3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.467197:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000af722a59/0xbacf56d076fab5d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632bc expref: 7 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.467205:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969434.467220:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783969434.467225:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058d86b44/0xbacf56d076fab5f3 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.467261:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000af722a59/0xbacf56d076fab5d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632bc expref: 7 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.467275:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000af722a59/0xbacf56d076fab5d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632bc expref: 7 pid: 6595 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969434.467288:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6593:1870627280585472:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783969434.467368:0:6593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7860b0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783969434.471202:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6593:1870627280585472:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783969434.471230:0:6593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000058d86b44/0xbacf56d076fab5f3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969434.472814:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969434.473045:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272188672 00000100:00100000:2.0:1783969434.473054:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272188672 00010000:00010000:3.0:1783969434.473708:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000af722a59/0xbacf56d076fab5d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632bc expref: 8 pid: 6595 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969434.473768:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 59 00000100:00100000:3.0:1783969434.473792:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7963b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+8:2350:x1870627272188672:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969434.473808:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969434.473831:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000af722a59/0xbacf56d076fab5d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632bc expref: 8 pid: 6595 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.473846:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000af722a59/0xbacf56d076fab5d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632bc expref: 8 pid: 6595 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.473887:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af722a59/0xbacf56d076fab5d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632bc expref: 8 pid: 6595 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.473903:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783969434.473908:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783969434.473913:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000058d86b44/0xbacf56d076fab5f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.473923:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058d86b44/0xbacf56d076fab5f3 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.473960:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969434.474025:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7963b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+7:2350:x1870627272188672:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 248us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969434.474033:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 59 00010000:00010000:1.0:1783969434.474171:0:6593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000058d86b44/0xbacf56d076fab5f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969434.474180:0:6593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058d86b44/0xbacf56d076fab5f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969434.474204:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000058d86b44/0xbacf56d076fab5f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969434.474212:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058d86b44/0xbacf56d076fab5f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969434.474219:0:6593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058d86b44/0xbacf56d076fab5f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969434.474225:0:6593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93800 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969434.474229:0:6593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058d86b44/0xbacf56d076fab5f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969434.474244:0:6593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058d86b44/0xbacf56d076fab5f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969434.474256:0:6593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058d86b44/0xbacf56d076fab5f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969434.474263:0:6593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058d86b44/0xbacf56d076fab5f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969434.474320:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+6:2351:x1870627272188544:12345-192.168.203.39@tcp:1:lhsmtool_posix.0 Request processed in 7256us (7458us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969434.474328:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 45 00000100:00100000:3.0:1783969434.478382:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969434.478472:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272188928 00000100:00100000:2.0:1783969434.478482:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272188928 00000100:00100000:2.0:1783969434.478541:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 127 00000100:00100000:2.0:1783969434.478551:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+14:10523:x1870627272188928:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783969434.478624:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab5fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.478641:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab5fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.478653:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab5fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.478832:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab601 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.478842:0:10288:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab5b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632a7 expref: 15 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.478851:0:10288:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab601 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.478919:0:10288:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab5b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632a7 expref: 15 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.478934:0:10288:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab5b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632a7 expref: 15 pid: 5795 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969434.478948:0:10288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac782fb3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10288:1870627280585600:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783969434.479055:0:10288:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac787d34e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783969434.484454:0:10288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac782fb3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10288:1870627280585600:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783969434.484482:0:10288:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab601 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969434.485247:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969434.485327:0:8304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272189056 00000100:00100000:0.0:1783969434.485335:0:8304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272189056 00010000:00010000:0.0:1783969434.485371:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab5b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632a7 expref: 16 pid: 5795 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969434.485411:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 60 00000100:00100000:0.0:1783969434.485421:0:8304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7960380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+16:2351:x1870627272189056:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969434.485434:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969434.485441:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab5b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632a7 expref: 16 pid: 5795 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.485472:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab5b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632a7 expref: 16 pid: 5795 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.485494:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab5b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632a7 expref: 16 pid: 5795 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.485511:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ac785336f00) 00010000:00010000:0.0:1783969434.485516:0:8304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab601 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.485525:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab601 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.485531:0:8304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab601 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.485559:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969434.485613:0:8304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7960380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+15:2351:x1870627272189056:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 193us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969434.485622:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 60 00010000:00010000:3.0:1783969434.486045:0:10288:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab601 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.486054:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab601 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783969434.486317:0:10288:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1783969434.486453:0:10288:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1783969434.486498:0:10288:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1783969434.486577:0:10288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7961880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10288:1870627280585728:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783969434.486646:0:10288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969434.488003:0:10288:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac791933c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783969434.490242:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280585728 00000100:00100000:2.0:1783969434.490257:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280585728 00000100:00100000:2.0:1783969434.492190:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783969434.492212:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10288:x1870627280585728:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1783969434.492361:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10288:x1870627280585728:12345-0@lo:1000:mdt00_004.0 Request processed in 159us (5714us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969434.492370:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783969434.492480:0:10288:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1783969434.492488:0:10288:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:3.0:1783969434.492510:0:10288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ac782fb2a00, transno 4294967309 00000004:00080000:3.0:1783969434.492523:0:10288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ac782fb0700, transno 4294967310 00000100:00100000:3.0:1783969434.492530:0:10288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7961880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10288:1870627280585728:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1783969434.493191:0:10288:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:3.0:1783969434.493271:0:10288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7961880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10288:1870627280585856:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1783969434.493326:0:10288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969434.496459:0:10288:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bf74c000 going to sleep for 11 seconds 00000100:00100000:1.0:1783969434.499170:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280585856 00000100:00100000:1.0:1783969434.499184:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280585856 00000100:00100000:1.0:1783969434.499244:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783969434.499253:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10288:x1870627280585856:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1783969434.499536:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10288:x1870627280585856:12345-0@lo:1000:mdt00_004.0 Request processed in 283us (6209us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1783969434.499545:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783969434.499704:0:10288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7961880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10288:1870627280585856:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1783969434.499757:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab601 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.499767:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab601 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.499774:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab601 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.499780:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2045400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969434.499784:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab601 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.499791:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab601 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.499805:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ac785336f00) 00010000:00010000:3.0:1783969434.499808:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783969434.499812:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab601 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.499818:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab601 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.499847:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab544 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.499854:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab544 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.499901:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab544 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.499918:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2044800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969434.499921:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab544 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.499927:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab544 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.499935:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:3.0:1783969434.499938:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783969434.499944:0:10288:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076fab54b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6328b expref: 18 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.499956:0:10288:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076fab54b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6328b expref: 18 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.499965:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076fab54b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6328b expref: 18 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.500008:0:10288:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076fab54b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6328b expref: 18 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969434.500022:0:10288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c18e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10288:1870627280585984:192.168.203.39@tcp:105: 00000100:00100000:3.0:1783969434.500103:0:10288:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bf74c000 going to sleep for 11 seconds 00000100:00100000:3.0:1783969434.503463:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969434.503526:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272189184 00000100:00100000:0.0:1783969434.503536:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272189184 00000100:00100000:0.0:1783969434.503594:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 31 00000100:00100000:0.0:1783969434.503604:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+19:10521:x1870627272189184:12345-192.168.203.39@tcp:49:lfs.0 00000100:00100000:0.0:1783969434.503732:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+19:10521:x1870627272189184:12345-192.168.203.39@tcp:49:lfs.0 Request processed in 129us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969434.503740:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 31 00000100:00100000:2.0:1783969434.504557:0:10288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c18e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10288:1870627280585984:192.168.203.39@tcp:105: 00010000:00010000:2.0:1783969434.504582:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab544 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.504593:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab544 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.504626:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab608 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.504639:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab608 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.504651:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab608 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.504660:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab608 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.504667:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab608 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.504674:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab608 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.504687:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2044a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969434.504691:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab608 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.504698:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab608 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.504710:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:2.0:1783969434.504713:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969434.504717:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab608 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.504722:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab608 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.504733:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab5fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.504739:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab5fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.504745:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab5fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.504751:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2044c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969434.504754:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab5fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.504760:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab5fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.504791:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:2.0:1783969434.504793:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783969434.504796:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab5fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.504802:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab5fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783969434.505258:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783969434.505263:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783969434.505761:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1783969434.505769:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783969434.506415:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+18:10523:x1870627272188928:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 26513us (26690us total) trans 4294967407 rc 0/0 00000100:00100000:2.0:1783969434.506430:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 127 00000020:00080000:2.0:1783969434.506437:0:10288:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1783969434.514042:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969434.514232:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272189440 00000100:00100000:1.0:1783969434.514240:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272189440 00000100:00100000:1.0:1783969434.514304:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 128 00000100:00100000:1.0:1783969434.514314:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+18:10521:x1870627272189440:12345-192.168.203.39@tcp:58:lfs.0 00000040:00080000:1.0:1783969434.514646:0:6618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1783969434.514741:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+18:10521:x1870627272189440:12345-192.168.203.39@tcp:58:lfs.0 Request processed in 427us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969434.514750:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 128 00000100:00100000:1.0:1783969434.516464:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969434.516544:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272189696 00000100:00100000:0.0:1783969434.516552:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272189696 00000100:00100000:0.0:1783969434.516599:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 32 00000100:00100000:0.0:1783969434.516608:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786072050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+18:10523:x1870627272189696:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1783969434.517438:0:5796:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1783969434.517544:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:0.0:1783969434.517593:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab60f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.517609:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab60f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.517620:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab60f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.517629:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab60f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.517635:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab60f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.517641:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab60f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.517669:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783969434.517897:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969434.517904:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab60f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.517910:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93c00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:2.0:1783969434.517914:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab60f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.517921:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab60f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.517934:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ac790086c00) 00010000:00010000:2.0:1783969434.517938:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783969434.517942:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab60f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.517947:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab60f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.517987:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969434.517989:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969434.517991:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969434.518153:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786072050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+20:10523:x1870627272189696:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 1542us (1693us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1783969434.518173:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 32 00000020:00080000:0.0:1783969434.518178:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783969434.542648:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969434.542747:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272189824 00000100:00100000:2.0:1783969434.542758:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272189824 00000100:00100000:2.0:1783969434.542827:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 129 00000100:00100000:2.0:1783969434.542838:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+20:10525:x1870627272189824:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783969434.542895:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969434.542920:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab616 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb632c3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.542993:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab61d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.543007:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab61d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.543019:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab61d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.543034:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab624 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.543042:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.543049:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.543543:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab62b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.543562:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab536 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63284 expref: 21 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.543570:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab62b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.543602:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab536 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63284 expref: 21 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969434.543617:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab536 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63284 expref: 21 pid: 5793 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969434.543632:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac782fb3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1870627280586112:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783969434.543904:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac787d34cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969434.546226:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac782fb3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1870627280586112:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969434.546255:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab62b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969434.547935:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969434.548036:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272190080 00000100:00100000:0.0:1783969434.548045:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272190080 00000100:00100000:0.0:1783969434.548113:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 33 00000100:00100000:0.0:1783969434.548123:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+22:5579:x1870627272190080:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783969434.548353:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+23:5579:x1870627272190080:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 230us (424us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1783969434.548361:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 33 00000100:00100000:3.0:1783969434.551959:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969434.552190:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272190208 00000100:00100000:0.0:1783969434.552199:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272190208 00010000:00010000:0.0:1783969434.552234:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab536 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63284 expref: 23 pid: 5793 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969434.552274:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 61 00000100:00100000:0.0:1783969434.552283:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a60c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+23:2351:x1870627272190208:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969434.552298:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969434.552305:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab536 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63284 expref: 23 pid: 5793 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.552318:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab536 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63284 expref: 23 pid: 5793 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.552340:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab536 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63284 expref: 23 pid: 5793 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.552371:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:0.0:1783969434.552376:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab62b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.552386:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab62b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.552393:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab62b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969434.552424:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969434.552481:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a60c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+22:2351:x1870627272190208:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 198us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969434.552489:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 61 00010000:00010000:3.0:1783969434.552671:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab62b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.552682:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab62b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969434.552735:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1783969434.552740:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783969434.552760:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab62b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.553051:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab62b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.553062:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab61d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.553070:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab61d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.553077:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab61d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.553084:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2044a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969434.553089:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab61d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.553096:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab61d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.553106:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:3.0:1783969434.553108:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969434.553121:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab61d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.553127:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab61d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.553140:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab624 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.553147:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab624 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.553153:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab624 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.553159:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2044800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969434.553162:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab624 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.553168:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab624 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.553176:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ac785336200) 00010000:00010000:3.0:1783969434.553179:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969434.553181:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab624 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.553187:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab624 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.553223:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab616 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632c3 expref: 22 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.553249:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab62b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632c3 expref: 21 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969434.553257:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:3.0:1783969434.553260:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783969434.553262:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c2045200, rc 0) 00000100:00100000:3.0:1783969434.553303:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+21:10525:x1870627272189824:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 10467us (10664us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969434.554450:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 129 00000001:00080000:1.0:1783969434.781084:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1783969434.781099:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:1.0:1783969435.174361:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783969435.302995:0:11902:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783969435.303005:0:11902:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783969435.303052:0:11902:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1783969435.303057:0:11902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1783969435.557127:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783969435.557138:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783969435.557177:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1783969435.557183:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783969435.557316:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac681f4c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1870627280586240:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783969435.557425:0:11535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7860b0900 going to sleep for 11 seconds 00000100:00100000:1.0:1783969435.564488:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969435.564614:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272190336 00000100:00100000:2.0:1783969435.564623:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272190336 00000100:00100000:2.0:1783969435.564673:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 130 00000100:00100000:2.0:1783969435.564682:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+22:10537:x1870627272190336:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783969435.564712:0:10288:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783969435.564818:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+22:10537:x1870627272190336:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 Request processed in 136us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969435.564825:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 130 00000100:00100000:0.0:1783969435.565668:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac681f4c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1870627280586240:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783969435.569724:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969435.569885:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272190592 00000100:00100000:0.0:1783969435.569895:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272190592 00000100:00100000:0.0:1783969435.569978:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 131 00000100:00100000:0.0:1783969435.569988:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac78872f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+21:10537:x1870627272190592:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783969435.570008:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969435.570028:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab632 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb632ca expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969435.570122:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab639 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969435.570136:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969435.570148:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969435.570159:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1783969435.570285:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab632 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632ca expref: 24 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969435.570312:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632ca expref: 23 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969435.570321:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:0.0:1783969435.570323:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969435.570326:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92400, rc 0) 00000100:00100000:0.0:1783969435.570384:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac78872f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+23:10537:x1870627272190592:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 398us (668us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1783969435.570391:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 131 00000100:00100000:3.0:1783969435.577269:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969435.577433:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969435.577605:0:8304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272190976 00000100:00100000:0.0:1783969435.577623:0:8304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272190976 00000100:00100000:0.0:1783969435.577697:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:0.0:1783969435.577708:0:8304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+23:2350:x1870627272190976:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969435.577723:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969435.577768:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab639 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632ca expref: 23 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969435.577785:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:0.0:1783969435.577790:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969435.577847:0:8304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+22:2350:x1870627272190976:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 141us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969435.577896:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:2.0:1783969435.578717:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272190848 00000100:00100000:2.0:1783969435.578724:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272190848 00000100:00100000:2.0:1783969435.578781:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 132 00000100:00100000:2.0:1783969435.578790:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+22:10537:x1870627272190848:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783969435.579026:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab647 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969435.579041:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab647 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969435.579052:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab647 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969435.579230:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab647 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969435.579238:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab647 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969435.579244:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab647 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969435.579251:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2045400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969435.579255:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab647 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969435.579261:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab647 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969435.579469:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:2.0:1783969435.579474:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783969435.579490:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab647 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969435.579561:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab647 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969435.579943:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+23:10537:x1870627272190848:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 1153us (2681us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1783969435.579952:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 132 00000040:00080000:0.0:1783969435.580132:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783969435.580136:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783969435.581042:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1783969435.581052:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783969435.584635:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969435.584785:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272191232 00000100:00100000:0.0:1783969435.584794:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272191232 00000100:00100000:0.0:1783969435.584847:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 34 00000100:00100000:0.0:1783969435.584901:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+23:10537:x1870627272191232:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783969435.585131:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+24:10537:x1870627272191232:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 233us (503us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1783969435.585139:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 34 00010000:00010000:1.0:1783969436.199358:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969436.261350:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783969436.261372:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac782fb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280586368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783969436.261435:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969436.261584:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280586368 00000100:00100000:3.0:1783969436.261591:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280586368 00000100:00100000:3.0:1783969436.261652:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783969436.261672:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782fb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1870627280586368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783969436.261704:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783969436.261759:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782fb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1870627280586368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969436.261768:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783969436.261808:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac782fb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280586368:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783969436.261959:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969436.779643:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7981bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1870627280586624:0@lo:400:kworker.0 00000100:00100000:1.0:1783969436.779711:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969436.779767:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969436.779774:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7981bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280586752:0@lo:400:kworker.0 00000100:00100000:1.0:1783969436.779797:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969436.779834:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280586624 00000100:00100000:1.0:1783969436.779841:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280586624 00000100:00100000:1.0:1783969436.779904:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280586752 00000100:00100000:1.0:1783969436.779907:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280586752 00000100:00100000:1.0:1783969436.779935:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1783969436.779943:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1870627280586624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969436.781124:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1870627280586624:12345-0@lo:400:kworker.0 Request processed in 1177us (1409us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969436.781136:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783969436.781432:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7981bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280586496:0@lo:400:kworker.0 00000100:00100000:2.0:1783969436.781485:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969436.781516:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7981bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280587008:0@lo:400:kworker.0 00000100:00100000:2.0:1783969436.781542:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969436.781565:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783969436.781571:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7981bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1870627280586880:0@lo:400:kworker.0 00000100:00100000:2.0:1783969436.781622:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969436.781652:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280586496 00000100:00100000:2.0:1783969436.781679:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280586496 00000100:00100000:2.0:1783969436.781742:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1783969436.781770:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3288:x1870627280586496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969436.781809:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3288:x1870627280586496:12345-0@lo:400:kworker.0 Request processed in 54us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969436.781815:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1783969436.781843:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280587008 00000100:00100000:2.0:1783969436.781846:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280587008 00000100:00100000:2.0:1783969436.781907:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783969436.781914:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782fb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280587008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969436.781946:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782fb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280587008:12345-0@lo:400:kworker.0 Request processed in 33us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969436.781953:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783969436.781984:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280586880 00000100:00100000:2.0:1783969436.781988:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280586880 00000100:00080000:0.0:1783969436.782099:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783969436.782105:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969436.782422:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1783969436.782432:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280586752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969436.782526:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280586752:12345-0@lo:400:kworker.0 Request processed in 96us (2727us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969436.782581:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783969436.782588:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870627280586880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969436.782620:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782fb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870627280586880:12345-0@lo:400:kworker.0 Request processed in 33us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969436.782626:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783969436.782672:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7981bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1870627280586880:0@lo:400:kworker.0 00000100:00100000:2.0:1783969436.782683:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7981bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280586496:0@lo:400:kworker.0 00000100:00100000:2.0:1783969436.782692:0:3288:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1783969436.782697:0:3288:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:2.0:1783969436.782714:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ac7bf742a00, transno 4294967301 00000004:00080000:2.0:1783969436.782725:0:3288:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1783969436.782733:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ac7a787d500, transno 4294967304 00000100:00100000:2.0:1783969436.782737:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7981bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280587008:0@lo:400:kworker.0 00000100:00100000:2.0:1783969436.786983:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7981bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280586752:0@lo:400:kworker.0 00000100:00100000:2.0:1783969436.787004:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7981bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1870627280586624:0@lo:400:kworker.0 00000100:00100000:1.0:1783969436.789721:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00010000:1.0:1783969437.221033:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783969437.245922:0:11953:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783969437.245932:0:11953:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783969437.246002:0:11953:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1783969437.246008:0:11953:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783969437.290324:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280587136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783969437.290620:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969437.290711:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280587136 00000100:00100000:3.0:1783969437.290718:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280587136 00000100:00100000:3.0:1783969437.290760:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783969437.290769:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280587136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783969437.290803:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783969437.291581:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280587136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 809us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969437.291590:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783969437.291644:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280587136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969437.507074:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969437.508085:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272191488 00000100:00100000:2.0:1783969437.508096:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272191488 00000100:00080000:0.0:1783969437.508148:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969437.508170:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 133 00000100:00100000:2.0:1783969437.508195:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+24:10557:x1870627272191488:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783969437.508219:0:10288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969437.508238:0:10288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab64e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb632d1 expref: -99 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969437.508833:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab655 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969437.508850:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab655 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969437.508951:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab655 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969437.508975:0:10288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783969437.509100:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044800/0xbacf56d076fab64e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632d1 expref: 27 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969437.509119:0:10288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab655 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632d1 expref: 26 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969437.509129:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:2.0:1783969437.509132:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783969437.509136:0:10288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c2044c00, rc 0) 00000100:00100000:2.0:1783969437.509256:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+26:10557:x1870627272191488:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1062us (2189us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1783969437.509264:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 133 00000100:00100000:3.0:1783969437.516757:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969437.516933:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272191616 00000100:00100000:0.0:1783969437.516944:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272191616 00000100:00100000:0.0:1783969437.517022:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 134 00000100:00100000:0.0:1783969437.517032:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+26:10557:x1870627272191616:12345-192.168.203.39@tcp:54:lfs.0 00010000:00010000:0.0:1783969437.517097:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab663 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969437.517114:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969437.517126:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969437.517151:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab663 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969437.517157:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab663 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969437.517163:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab663 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969437.517168:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969437.517173:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab663 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969437.517179:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab663 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969437.517207:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:0.0:1783969437.517210:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783969437.517215:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab663 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969437.517222:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab663 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969437.517285:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+26:10557:x1870627272191616:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 254us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969437.517293:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 134 00000100:00100000:3.0:1783969437.610980:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969437.611177:0:9934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272191744 00000100:00100000:2.0:1783969437.611187:0:9934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272191744 00000100:00100000:2.0:1783969437.611287:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 46 00000100:00100000:2.0:1783969437.611297:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+6:2351:x1870627272191744:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:2.0:1783969437.611313:0:9934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969437.611334:0:9934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006dbf6aa6/0xbacf56d076fab66a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb632d8 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783969437.611359:0:9934:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a553699, atime: 0x6a553698, ctime: 0x6a553699, blocks: 0xb 00010000:00010000:2.0:1783969437.611380:0:9934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=294s v=(0 0) 00010000:00010000:2.0:1783969437.611385:0:9934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969437.611394:0:9934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dbf6aa6/0xbacf56d076fab66a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632d8 expref: 7 pid: 9934 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969437.611418:0:9934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006dbf6aa6/0xbacf56d076fab66a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632d8 expref: 7 pid: 9934 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969437.611430:0:9934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c2044800, rc 0) 00000100:00100000:2.0:1783969437.611488:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+7:2351:x1870627272191744:12345-192.168.203.39@tcp:101:cat.0 Request processed in 193us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969437.611495:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 46 00000100:00080000:0.0:1783969437.611608:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969437.616705:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969437.616964:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272191872 00000100:00100000:0.0:1783969437.616973:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272191872 00002000:00100000:0.0:1783969437.617020:0:6600:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9ac7981bce00 x1870627272191872/t0(0) o3->03985e57-ffb4-414b-b30c-e72697857d4f@192.168.203.39@tcp:333/0 lens 488/0 e 0 to 0 dl 1783969448 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783969437.617031:0:6600:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac7981bce00 with x1870627272191872 ext(0->4095) 00002000:00010000:0.0:1783969437.617037:0:6600:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ac7981bce00 00000100:00100000:0.0:1783969437.617069:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3 00000100:00100000:0.0:1783969437.617079:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:03985e57-ffb4-414b-b30c-e72697857d4f+7:2350:x1870627272191872:12345-192.168.203.39@tcp:3:cat.0 00000100:00100000:0.0:1783969437.617304:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:03985e57-ffb4-414b-b30c-e72697857d4f+7:2350:x1870627272191872:12345-192.168.203.39@tcp:3:cat.0 Request processed in 225us (606us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1783969437.617311:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3 00002000:00100000:0.0:1783969437.617319:0:6600:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9ac7981bce00 x1870627272191872/t0(0) o3->03985e57-ffb4-414b-b30c-e72697857d4f@192.168.203.39@tcp:333/0 lens 488/4536 e 0 to 0 dl 1783969448 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783969437.617327:0:6600:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac7981bce00 with x1870627272191872 ext(0->4095) 00002000:00010000:0.0:1783969437.617343:0:6600:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ac7981bce00 00010000:00010000:1.0:1783969438.245362:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969438.265024:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969438.265110:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969438.265143:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969438.265354:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272192128 00000100:00100000:0.0:1783969438.265364:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272192128 00000100:00100000:0.0:1783969438.265422:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 60 00000100:00100000:0.0:1783969438.265430:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+5:2351:x1870627272192128:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969438.265497:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+5:2351:x1870627272192128:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 67us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969438.265504:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 60 00000100:00100000:1.0:1783969438.265837:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272192256 00000100:00100000:1.0:1783969438.265842:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272192256 00000100:00100000:1.0:1783969438.265909:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 131 00000100:00100000:1.0:1783969438.265917:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2351:x1870627272192256:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969438.265964:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2351:x1870627272192256:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 48us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969438.265971:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 131 00000100:00080000:3.0:1783969438.266174:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783969438.266178:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783969438.270106:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272192000 00000100:00100000:2.0:1783969438.270120:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272192000 00000100:00100000:2.0:1783969438.270198:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 285 00000100:00100000:2.0:1783969438.270208:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2351:x1870627272192000:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783969438.270812:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2351:x1870627272192000:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 602us (5794us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969438.270821:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 285 00010000:00010000:1.0:1783969439.274343:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783969439.422924:0:11828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1783969439.422962:0:11828:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:3.0:1783969439.422987:0:11828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1783969439.423003:0:11828:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ac791933f00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1783969439.423008:0:11828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ac785661c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ac7b2f3bc00 00000020:00080000:3.0:1783969439.423012:0:11828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ac785661400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ac782fbd800 00000020:00080000:2.0:1783969439.423884:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1783969439.424159:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:3.0:1783969439.953344:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1783969439.953365:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:2.0:1783969440.293114:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969441.317152:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969441.381119:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac782fb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280587264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969441.381210:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969441.381353:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280587264 00000100:00100000:2.0:1783969441.381361:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280587264 00000100:00100000:2.0:1783969441.381451:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783969441.381470:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280587264:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783969441.381472:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1783969441.381508:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783969441.381552:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280587264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969441.381559:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783969441.382104:0:3286:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1783969441.382117:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1783969441.382143:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac782fb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280587264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783969441.896100:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac782fb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280587392:0@lo:400:kworker.0 00000100:00100000:0.0:1783969441.896175:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969441.896280:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280587392 00000100:00100000:1.0:1783969441.896287:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280587392 00000100:00100000:1.0:1783969441.896334:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1783969441.896342:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+19:3287:x1870627280587392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969441.896476:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac782fb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870627280587520:0@lo:400:kworker.0 00000100:00100000:3.0:1783969441.896509:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969441.896550:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280587520 00000100:00100000:3.0:1783969441.896554:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280587520 00000100:00100000:3.0:1783969441.896584:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783969441.896591:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870627280587520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969441.896627:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870627280587520:12345-0@lo:400:kworker.0 Request processed in 36us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969441.896635:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783969441.896671:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac782fb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870627280587520:0@lo:400:kworker.0 00000100:00100000:0.0:1783969441.899023:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac782fb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280587392:0@lo:400:kworker.0 00000100:00100000:1.0:1783969441.899024:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+19:3287:x1870627280587392:12345-0@lo:400:kworker.0 Request processed in 2675us (2841us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969441.899042:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1783969441.900319:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac782fb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1870627280587776:0@lo:400:kworker.0 00000100:00100000:3.0:1783969441.900426:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969441.900471:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783969441.900478:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac782fb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1870627280587648:0@lo:400:kworker.0 00000100:00100000:3.0:1783969441.900511:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969441.900545:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280587776 00000100:00100000:3.0:1783969441.900552:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280587776 00000100:00100000:3.0:1783969441.900598:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280587648 00000100:00100000:3.0:1783969441.900602:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280587648 00000100:00100000:3.0:1783969441.900624:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1783969441.900633:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1870627280587776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969441.900985:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1870627280587776:12345-0@lo:400:kworker.0 Request processed in 352us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969441.900993:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1783969441.902212:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac782fb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280587904:0@lo:400:kworker.0 00000100:00100000:1.0:1783969441.902270:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969441.902469:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783969441.902482:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1870627280587648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969441.902534:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1870627280587648:12345-0@lo:400:kworker.0 Request processed in 56us (2022us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969441.902540:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783969441.902564:0:9934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280587904 00000100:00100000:2.0:1783969441.902569:0:9934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280587904 00000100:00100000:2.0:1783969441.902606:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783969441.902612:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280587904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969441.902645:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280587904:12345-0@lo:400:kworker.0 Request processed in 33us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969441.902651:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783969441.903057:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac782fb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280587904:0@lo:400:kworker.0 00000100:00080000:2.0:1783969441.903090:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783969441.903096:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969441.903129:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac782fb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1870627280587648:0@lo:400:kworker.0 00000100:00100000:2.0:1783969441.903154:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac782fb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1870627280587776:0@lo:400:kworker.0 00010000:00010000:1.0:1783969442.342784:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969442.408176:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969442.408211:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280588032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969442.408286:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969442.416772:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280588032 00000100:00100000:3.0:1783969442.416785:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280588032 00000100:00100000:3.0:1783969442.416851:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783969442.416891:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280588032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783969442.416948:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783969442.417035:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280588032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 175us (8748us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969442.417042:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783969442.417126:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280588032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969442.457107:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969442.457323:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272192384 00000100:00100000:2.0:1783969442.457334:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272192384 00000100:00100000:2.0:1783969442.457404:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 135 00000100:00100000:2.0:1783969442.457603:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+13:10210:x1870627272192384:12345-192.168.203.39@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1783969442.457710:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+13:10210:x1870627272192384:12345-192.168.203.39@tcp:60:lhsmtool_posix.0 Request processed in 296us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969442.458314:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 135 00000100:00080000:1.0:1783969442.458383:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969442.462731:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969442.462939:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272192640 00000100:00100000:1.0:1783969442.462948:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272192640 00000100:00100000:1.0:1783969442.463007:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 35 00000100:00100000:1.0:1783969442.463017:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+13:10210:x1870627272192640:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783969442.463570:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+14:10210:x1870627272192640:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 553us (859us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1783969442.463577:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 35 00000100:00100000:3.0:1783969442.688826:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969442.689329:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272192768 00000100:00100000:2.0:1783969442.689341:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272192768 00000100:00100000:2.0:1783969442.689421:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 136 00000100:00100000:2.0:1783969442.689431:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:11009:x1870627272192768:12345-192.168.203.39@tcp:101:lsof.0 00010000:00010000:2.0:1783969442.689451:0:10288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1783969442.689451:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783969442.689473:0:10288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab671 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb632df expref: -99 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969442.689532:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab678 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969442.689547:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab678 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969442.689558:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab678 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969442.689834:0:10288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783969442.689838:0:10288:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1783969442.690193:0:10288:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab678 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969442.690221:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab671 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632df expref: 7 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969442.690254:0:10288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab678 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632df expref: 6 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969442.690262:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac78c550100) 00010000:00010000:2.0:1783969442.690265:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783969442.690268:0:10288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c2044a00, rc 0) 00000100:00100000:2.0:1783969442.690333:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+6:11009:x1870627272192768:12345-192.168.203.39@tcp:101:lsof.0 Request processed in 904us (1516us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969442.690341:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 136 00000040:00080000:3.0:1783969442.789775:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783969442.789785:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783969442.789824:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1783969442.789830:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1783969443.365073:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969443.381286:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969443.381328:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969443.381362:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969443.381393:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969443.381416:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969443.381491:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272193408 00000100:00100000:1.0:1783969443.381501:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272193408 00000100:00100000:1.0:1783969443.381553:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272193024 00000100:00100000:1.0:1783969443.381556:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272193024 00000100:00100000:1.0:1783969443.381576:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 135 00000100:00100000:1.0:1783969443.381586:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782fb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+6:2350:x1870627272193408:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969443.381625:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272193152 00000100:00100000:0.0:1783969443.381631:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272193152 00000100:00100000:1.0:1783969443.381663:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782fb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+6:2350:x1870627272193408:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 77us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969443.381672:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 135 00000100:00100000:0.0:1783969443.381687:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272193280 00000100:00100000:0.0:1783969443.381691:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272193280 00000100:00100000:1.0:1783969443.381695:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 136 00000100:00100000:1.0:1783969443.381706:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+14:2350:x1870627272193024:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969443.381719:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 62 00000100:00100000:0.0:1783969443.381729:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782fb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+6:2350:x1870627272193152:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969443.381741:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782fb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+14:2350:x1870627272193024:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 36us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969443.381748:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 136 00000100:00100000:0.0:1783969443.381765:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782fb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+6:2350:x1870627272193152:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 37us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969443.381773:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 62 00000100:00100000:0.0:1783969443.381788:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 63 00000100:00100000:0.0:1783969443.381806:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+5:2350:x1870627272193280:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969443.381831:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782fb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+5:2350:x1870627272193280:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 36us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969443.381845:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 63 00000100:00080000:0.0:1783969443.381929:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783969443.381933:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969443.382200:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272192896 00000100:00100000:3.0:1783969443.382205:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272192896 00000100:00100000:3.0:1783969443.382251:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 287 00000100:00100000:3.0:1783969443.382259:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2350:x1870627272192896:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969443.382302:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2350:x1870627272192896:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 43us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969443.382309:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 287 00010000:00010000:1.0:1783969444.391004:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783969444.508544:0:11829:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1783969444.508757:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1783969444.508788:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1783969444.508798:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1783969445.413335:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783969446.096364:0:12153:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 15:04:04 (1783969444) 00010000:00010000:2.0:1783969446.437172:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969446.502577:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac782fb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280588160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969446.502647:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969446.503345:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280588160 00000100:00100000:2.0:1783969446.503355:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280588160 00000100:00100000:2.0:1783969446.503415:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783969446.503444:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280588160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969446.503479:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783969446.503541:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280588160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969446.503548:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1783969446.503569:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783969446.504648:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac782fb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280588160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969447.013160:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280588416:0@lo:400:kworker.0 00000100:00100000:1.0:1783969447.013229:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969447.013384:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280588416 00000100:00100000:0.0:1783969447.013393:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280588416 00000100:00100000:0.0:1783969447.013444:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783969447.013454:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280588416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969447.013537:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280588288:0@lo:400:kworker.0 00000100:00100000:2.0:1783969447.013583:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969447.013619:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1870627280588544:0@lo:400:kworker.0 00000100:00100000:2.0:1783969447.013643:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969447.013681:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280588544 00000100:00100000:2.0:1783969447.013685:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280588544 00000100:00100000:2.0:1783969447.013715:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783969447.013721:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870627280588544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969447.013754:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782fb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870627280588544:12345-0@lo:400:kworker.0 Request processed in 34us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969447.013762:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1783969447.013797:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969447.013821:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1870627280588544:0@lo:400:kworker.0 00000100:00100000:2.0:1783969447.013882:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280588288 00000100:00100000:2.0:1783969447.013886:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280588288 00000100:00100000:2.0:1783969447.013921:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1783969447.013927:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+19:3286:x1870627280588288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969447.013959:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+19:3286:x1870627280588288:12345-0@lo:400:kworker.0 Request processed in 32us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969447.013965:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1783969447.014010:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280588288:0@lo:400:kworker.0 00000100:00100000:3.0:1783969447.022406:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783969447.022423:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280588928:0@lo:400:kworker.0 00000100:00100000:3.0:1783969447.022510:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969447.022567:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1870627280588800:0@lo:400:kworker.0 00000100:00100000:3.0:1783969447.022595:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969447.022615:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783969447.022629:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280588672:0@lo:400:kworker.0 00000100:00100000:3.0:1783969447.022653:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969447.022682:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280588800 00000100:00100000:3.0:1783969447.022689:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280588800 00000100:00100000:3.0:1783969447.022755:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783969447.022764:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bfdbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1870627280588800:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783969447.026046:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969447.026089:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280588928 00000100:00100000:2.0:1783969447.026099:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280588928 00000100:00100000:2.0:1783969447.026157:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280588672 00000100:00100000:2.0:1783969447.026160:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280588672 00000100:00100000:2.0:1783969447.026179:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783969447.026188:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bfdbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280588928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969447.026279:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bfdbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280588928:12345-0@lo:400:kworker.0 Request processed in 92us (3769us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969447.026287:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783969447.026301:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783969447.026306:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bfdbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280588672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969447.026336:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bfdbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280588672:12345-0@lo:400:kworker.0 Request processed in 30us (3682us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969447.026342:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1783969447.026353:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783969447.026386:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280588928:0@lo:400:kworker.0 00000100:00100000:2.0:1783969447.026417:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280588672:0@lo:400:kworker.0 00000100:00100000:3.0:1783969447.026707:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bfdbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1870627280588800:12345-0@lo:400:kworker.0 Request processed in 3943us (4109us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969447.026716:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783969447.026781:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1870627280588800:0@lo:400:kworker.0 00000100:00100000:0.0:1783969447.028047:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280588416:12345-0@lo:400:kworker.0 Request processed in 14588us (14811us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969447.028057:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783969447.028621:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280588416:0@lo:400:kworker.0 00010000:00010000:1.0:1783969447.461065:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969447.525991:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bfdbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280589056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969447.526059:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969447.526177:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280589056 00000100:00100000:3.0:1783969447.526184:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280589056 00000100:00100000:3.0:1783969447.526244:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783969447.526253:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280589056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783969447.526286:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783969447.526339:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280589056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969447.526347:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783969447.526398:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bfdbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280589056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783969447.535420:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969447.535577:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272193664 00000100:00100000:0.0:1783969447.535586:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272193664 00000100:00100000:0.0:1783969447.535649:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 137 00000100:00100000:0.0:1783969447.535658:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782fb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+13:11274:x1870627272193664:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783969447.535677:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969447.535695:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab67f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb632e6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969447.535757:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab686 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969447.535770:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab686 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969447.535807:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab686 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969447.535821:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab68d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969447.535827:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab68d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969447.535833:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab68d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969447.536327:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab694 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969447.536337:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab694 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969447.536344:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab694 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969447.536354:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00000100:00080000:2.0:1783969447.537924:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783969447.538145:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab686 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969447.538158:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab686 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969447.538166:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab686 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969447.538172:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969447.538183:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab686 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969447.538191:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab686 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969447.538217:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ac790086f00) 00010000:00010000:0.0:1783969447.538220:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969447.538224:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab686 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969447.538231:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab686 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969447.538245:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab68d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969447.538251:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab68d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969447.538256:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab68d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969447.538260:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969447.538263:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab68d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969447.538268:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab68d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969447.538275:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ac790086600) 00010000:00010000:0.0:1783969447.538278:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969447.538288:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab68d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969447.538295:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab68d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969447.540189:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab67f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632e6 expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969447.540215:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab694 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632e6 expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969447.540223:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac790086e00) 00010000:00010000:0.0:1783969447.540227:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969447.540230:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92e00, rc 0) 00000100:00100000:0.0:1783969447.540309:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782fb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+15:11274:x1870627272193664:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 4651us (4896us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1783969447.540319:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 137 00000100:00100000:1.0:1783969447.549976:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969447.551313:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272193792 00000100:00100000:2.0:1783969447.551325:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272193792 00000100:00100000:2.0:1783969447.551400:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 138 00000100:00100000:2.0:1783969447.551411:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+15:11274:x1870627272193792:12345-192.168.203.39@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1783969447.551538:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+15:11274:x1870627272193792:12345-192.168.203.39@tcp:59:lhsmtool_posix.0 Request processed in 128us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969447.551546:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 138 00000100:00100000:3.0:1783969447.563186:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969447.564933:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272193920 00000100:00100000:2.0:1783969447.564949:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272193920 00000100:00100000:2.0:1783969447.565030:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:2.0:1783969447.565041:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bfdbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+15:2351:x1870627272193920:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969447.565057:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969447.565082:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab694 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632e6 expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969447.565103:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac790086e00) 00010000:00010000:2.0:1783969447.565108:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969447.565176:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bfdbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+14:2351:x1870627272193920:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 136us (1995us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969447.565184:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 9 00000040:00080000:1.0:1783969447.909709:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783969447.909719:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783969447.909827:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1783969447.909835:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1783969448.486118:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969448.501498:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969448.501541:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969448.501568:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969448.501600:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969448.501628:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272194560 00000100:00100000:0.0:1783969448.501637:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272194560 00000100:00100000:0.0:1783969448.501690:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272194176 00000100:00100000:0.0:1783969448.501693:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272194176 00000100:00100000:0.0:1783969448.501713:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 140 00000100:00100000:0.0:1783969448.501723:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+6:2350:x1870627272194560:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969448.501802:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+6:2350:x1870627272194560:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 80us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969448.501810:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 140 00000100:00100000:0.0:1783969448.501826:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 141 00000100:00100000:0.0:1783969448.501832:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+14:2350:x1870627272194176:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969448.501900:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+14:2350:x1870627272194176:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 26us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969448.501909:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 141 00000100:00100000:3.0:1783969448.502232:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272194048 00000100:00100000:3.0:1783969448.502237:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272194048 00000100:00100000:2.0:1783969448.502337:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272194304 00000100:00100000:2.0:1783969448.502341:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272194304 00000100:00100000:2.0:1783969448.502371:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 66 00000100:00100000:2.0:1783969448.502378:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681f4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+6:2350:x1870627272194304:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783969448.502410:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681f4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+6:2350:x1870627272194304:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 33us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969448.502416:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 66 00000100:00080000:2.0:1783969448.502437:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783969448.502441:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969448.507477:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 289 00000100:00100000:3.0:1783969448.507496:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2350:x1870627272194048:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969448.507697:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2350:x1870627272194048:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 208us (6207us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969448.507706:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 289 00000100:00100000:0.0:1783969448.507831:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969448.508353:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272194432 00000100:00100000:3.0:1783969448.508361:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272194432 00000100:00100000:3.0:1783969448.508489:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 67 00000100:00100000:3.0:1783969448.508498:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+5:2350:x1870627272194432:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969448.508545:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7961880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+5:2350:x1870627272194432:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 49us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969448.508552:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 67 00000100:00080000:2.0:1783969448.509291:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783969449.509732:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969449.509791:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272194688 00000100:00100000:0.0:1783969449.509800:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272194688 00000100:00100000:0.0:1783969449.509870:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 139 00000100:00100000:0.0:1783969449.509890:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+14:11315:x1870627272194688:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783969449.509909:0:10288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969449.509928:0:10288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab6a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb632ed expref: -99 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.509986:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab6a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.510001:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab6a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.510014:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab6a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.510042:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab6b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.510049:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab6b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.510055:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab6b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.510333:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab6a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.510341:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab6a9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.510346:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab6a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.510352:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969449.510366:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab6a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.510373:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab6a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.510385:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac78c550100) 00010000:00010000:0.0:1783969449.510388:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969449.510392:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab6a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.510399:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab6a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.511273:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab6b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.511280:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab6b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.511285:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab6b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.511289:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969449.511292:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab6b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.511298:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab6b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.511316:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ac790086a00) 00010000:00010000:0.0:1783969449.511319:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969449.511322:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab6b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.511328:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab6b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.511371:0:10288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab6a2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632ed expref: 15 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.511382:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac78c550100) 00010000:00010000:0.0:1783969449.511384:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969449.511395:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab6a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632ed expref: 15 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.511405:0:10288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92600, rc 0) 00000100:00100000:0.0:1783969449.511475:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+14:11315:x1870627272194688:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1596us (1753us total) trans 0 rc 301/301 00000100:00100000:0.0:1783969449.511484:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 139 00000100:00080000:0.0:1783969449.511511:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783969449.511905:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969449.525675:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969449.525712:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272194944 00000100:00100000:0.0:1783969449.525720:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272194944 00000100:00100000:0.0:1783969449.525783:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 140 00000100:00100000:0.0:1783969449.525793:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+14:11315:x1870627272194944:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:0.0:1783969449.525846:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969449.525896:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7e00/0xbacf56d076fab020 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63126 expref: 14 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.525913:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac78c550100) 00010000:00010000:0.0:1783969449.525917:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783969449.526164:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab6b7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.526177:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab678 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632df expref: 5 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.526185:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab6b7 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.526213:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab678 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632df expref: 5 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.526233:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab678 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632df expref: 5 pid: 10288 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969449.526246:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7960380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5794:1870627280589184:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783969449.526338:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac791f79240 going to sleep for 11 seconds 00000100:00100000:3.0:1783969449.529996:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969449.530035:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272195072 00000100:00100000:3.0:1783969449.530043:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272195072 00010000:00010000:3.0:1783969449.530081:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab678 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632df expref: 6 pid: 10288 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969449.530156:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 62 00000100:00100000:3.0:1783969449.530166:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bfdbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+6:2350:x1870627272195072:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969449.530178:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969449.530185:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab678 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632df expref: 6 pid: 10288 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969449.530198:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab678 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632df expref: 6 pid: 10288 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969449.530219:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac78c550100) 00010000:00010000:3.0:1783969449.530224:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab6b7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969449.530234:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab6b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969449.530250:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab6b7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969449.530268:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969449.530311:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bfdbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+6:2350:x1870627272195072:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 147us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969449.530318:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 62 00010000:00010000:0.0:1783969449.530714:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab678 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632df expref: 5 pid: 10288 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969449.530730:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7960380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5794:1870627280589184:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783969449.530760:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab6b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.530769:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab6b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.530776:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab6b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.530797:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab6be lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.530806:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab6be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.530814:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab6be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969449.534128:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1783969449.534151:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab6b7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.534162:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab6b7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.534169:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab6b7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.534175:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969449.534180:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab6b7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.534188:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab6b7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.534202:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac78c550100) 00010000:00010000:0.0:1783969449.534205:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969449.534210:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab6b7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.534215:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab6b7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783969449.534232:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000528e6a44 reply state 000000009878a6a3 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab6be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969449.534241:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783969449.534346:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7963b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+15:11315:x1870627272194944:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 8550us (8676us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1783969449.535941:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 140 00010000:00010000:3.0:1783969449.542264:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab6be lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969449.542280:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab6be lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969449.542288:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab6be lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969449.542294:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969449.542299:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab6be lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969449.542317:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab6be lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969449.542334:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ac790086a00) 00010000:00010000:3.0:1783969449.542337:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969449.542342:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab6be lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969449.542356:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab6be lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783969449.646905:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000100:00100000:0.0:1783969449.650679:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969449.650781:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272195200 00000100:00100000:2.0:1783969449.650790:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272195200 00000100:00100000:2.0:1783969449.650847:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 141 00000100:00100000:2.0:1783969449.650891:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+12:11324:x1870627272195200:12345-192.168.203.39@tcp:101:lctl.0 00010000:00010000:2.0:1783969449.650914:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969449.650936:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab6c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb632f4 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.651473:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab6cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.651489:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab6cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.651502:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab6cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969449.651695:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783969449.651700:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1783969449.651781:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab6cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.651807:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab6c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632f4 expref: 14 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.651826:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab6cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632f4 expref: 13 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.651834:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac785336e00) 00010000:00010000:2.0:1783969449.651844:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783969449.651847:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7c2044a00, rc 0) 00000100:00100000:2.0:1783969449.651959:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+13:11324:x1870627272195200:12345-192.168.203.39@tcp:101:lctl.0 Request processed in 1102us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969449.651966:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 141 00000100:00100000:0.0:1783969449.723009:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969449.723106:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272195328 00000100:00100000:2.0:1783969449.723115:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272195328 00000100:00100000:2.0:1783969449.723175:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 142 00000100:00100000:2.0:1783969449.723185:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac787782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+13:11330:x1870627272195328:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:2.0:1783969449.723203:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969449.723224:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab6d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb632fb expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.723284:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab6da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.723297:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab6da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.723319:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab6da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.723357:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098a00/0xbacf56d076fab6e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.723365:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098a00/0xbacf56d076fab6e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.723371:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098a00/0xbacf56d076fab6e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.723771:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099800/0xbacf56d076fab6e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.723781:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099800/0xbacf56d076fab6e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.723789:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099800/0xbacf56d076fab6e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969449.723924:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1783969449.723929:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783969449.724006:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099800/0xbacf56d076fab6e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.724020:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab6da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.724026:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab6da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.724032:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab6da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.724038:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c2045400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969449.724042:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab6da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.724049:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab6da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.724062:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac785336e00) 00010000:00010000:2.0:1783969449.724072:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969449.724077:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab6da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.724083:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045400/0xbacf56d076fab6da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.724096:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098a00/0xbacf56d076fab6e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.724102:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098a00/0xbacf56d076fab6e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.724107:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098a00/0xbacf56d076fab6e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.724112:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786098a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969449.724115:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098a00/0xbacf56d076fab6e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.724121:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098a00/0xbacf56d076fab6e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.724129:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ac785336500) 00010000:00010000:2.0:1783969449.724132:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969449.724135:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098a00/0xbacf56d076fab6e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.724140:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098a00/0xbacf56d076fab6e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.724170:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045a00/0xbacf56d076fab6d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632fb expref: 15 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.724197:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099800/0xbacf56d076fab6e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632fb expref: 14 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.724204:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:2.0:1783969449.724206:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783969449.724208:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786099800, rc 0) 00000100:00100000:2.0:1783969449.724273:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac787782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+14:11330:x1870627272195328:12345-192.168.203.39@tcp:101:bash.0 Request processed in 1088us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969449.724280:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 142 00000100:00100000:3.0:1783969449.727340:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969449.727409:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272195584 00000100:00100000:0.0:1783969449.727420:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272195584 00000100:00100000:0.0:1783969449.727482:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 143 00000100:00100000:0.0:1783969449.727491:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bfdbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+14:11330:x1870627272195584:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:0.0:1783969449.727510:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969449.727529:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab6ef lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63302 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.727833:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab6f6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.727847:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab6f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.727912:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab6f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.727949:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab6fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.727956:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab6fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.727963:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab6fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783969449.728932:0:5794:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1783969449.729479:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab704 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.729503:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.729512:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.729550:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab6f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.729556:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab6f6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.729563:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab6f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.729569:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969449.729573:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab6f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.729580:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab6f6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.729592:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:0.0:1783969449.729595:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969449.729600:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab6f6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.729605:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab6f6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783969449.729616:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b0b2f9d1 reply state 0000000038ce3bb3 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab6fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969449.729630:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783969449.729666:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab6ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63302 expref: 17 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.729682:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab704 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63302 expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.729688:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac790086300) 00010000:00010000:0.0:1783969449.729690:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969449.729693:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93e00, rc 0) 00000100:00100000:0.0:1783969449.729823:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bfdbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+17:11330:x1870627272195584:12345-192.168.203.39@tcp:101:bash.0 Request processed in 2333us (2491us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1783969449.729833:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 143 00000100:00100000:1.0:1783969449.743310:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969449.743393:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272195712 00000100:00100000:2.0:1783969449.743402:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272195712 00000100:00100000:2.0:1783969449.743473:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 47 00000100:00100000:2.0:1783969449.743483:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+5:2351:x1870627272195712:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:2.0:1783969449.743500:0:6594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969449.743520:0:6594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009219ae06/0xbacf56d076fab712 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63309 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783969449.743546:0:6594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783969449.743565:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=306s v=(0 0) 00010000:00010000:2.0:1783969449.743569:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969449.743579:0:6594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009219ae06/0xbacf56d076fab712 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63309 expref: 6 pid: 6594 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.743599:0:6594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009219ae06/0xbacf56d076fab712 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63309 expref: 6 pid: 6594 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.743624:0:6594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786098a00, rc 0) 00000100:00100000:2.0:1783969449.743692:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+6:2351:x1870627272195712:12345-192.168.203.39@tcp:101:bash.0 Request processed in 210us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969449.743699:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 47 00000100:00100000:1.0:1783969449.748791:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:0.0:1783969449.750893:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab6fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.750910:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab6fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.750917:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab6fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.750924:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969449.750929:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab6fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.750937:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab6fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.750973:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ac790086c00) 00010000:00010000:0.0:1783969449.750976:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969449.750981:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab6fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.750988:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab6fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969449.753610:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272195840 00000100:00100000:2.0:1783969449.753623:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272195840 00000100:00100000:2.0:1783969449.753686:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 48 00000100:00100000:2.0:1783969449.753694:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+6:11330:x1870627272195840:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:2.0:1783969449.753711:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969449.753727:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069e02287/0xbacf56d076fab719 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63310 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.753758:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009219ae06/0xbacf56d076fab712 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63309 expref: 7 pid: 6594 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.753767:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969449.753771:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969449.753776:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069e02287/0xbacf56d076fab719 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63310 expref: 7 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.753806:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009219ae06/0xbacf56d076fab712 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63309 expref: 7 pid: 6594 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.753818:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009219ae06/0xbacf56d076fab712 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63309 expref: 7 pid: 6594 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969449.753844:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac782fb3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6593:1870627280589312:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783969449.753949:0:6593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bf56e240 going to sleep for 11 seconds 00000100:00100000:2.0:1783969449.761856:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac782fb3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6593:1870627280589312:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969449.761928:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000069e02287/0xbacf56d076fab719 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63310 expref: 7 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.761950:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786099c00, rc 0) 00000100:00100000:2.0:1783969449.762024:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+7:11330:x1870627272195840:12345-192.168.203.39@tcp:101:bash.0 Request processed in 8329us (13240us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969449.762032:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 48 00000100:00100000:1.0:1783969449.765123:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969449.765213:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272195968 00000100:00100000:2.0:1783969449.765222:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272195968 00010000:00010000:2.0:1783969449.765257:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009219ae06/0xbacf56d076fab712 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63309 expref: 7 pid: 6594 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969449.765295:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 63 00000100:00100000:2.0:1783969449.765304:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1666300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+7:2350:x1870627272195968:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969449.765319:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969449.765340:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009219ae06/0xbacf56d076fab712 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63309 expref: 7 pid: 6594 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.765354:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009219ae06/0xbacf56d076fab712 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63309 expref: 7 pid: 6594 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.765394:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009219ae06/0xbacf56d076fab712 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63309 expref: 7 pid: 6594 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.765411:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969449.765417:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969449.765426:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000069e02287/0xbacf56d076fab719 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63310 expref: 6 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.765437:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069e02287/0xbacf56d076fab719 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63310 expref: 6 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.765472:0:5778:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000069e02287/0xbacf56d076fab719 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63310 expref: 6 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969449.765486:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac782fb3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5778:1870627280589440:192.168.203.39@tcp:105: 00000100:00100000:2.0:1783969449.765616:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bf56e240 going to sleep for 11 seconds 00000100:00100000:1.0:1783969449.784933:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969449.785011:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272196224 00000100:00100000:0.0:1783969449.785020:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272196224 00000100:00100000:0.0:1783969449.785067:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 36 00000100:00100000:0.0:1783969449.785075:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+16:11330:x1870627272196224:12345-192.168.203.39@tcp:35:bash.0 00000100:00100000:0.0:1783969449.785419:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+17:11330:x1870627272196224:12345-192.168.203.39@tcp:35:bash.0 Request processed in 343us (494us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1783969449.785428:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 36 00000100:00100000:2.0:1783969449.785638:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac782fb3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5778:1870627280589440:192.168.203.39@tcp:105: 00010000:00010000:2.0:1783969449.785655:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969449.785674:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1666300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+6:2350:x1870627272195968:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 20371us (20560us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969449.785680:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 63 00000100:00100000:1.0:1783969449.898509:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969449.898595:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272196480 00000100:00100000:2.0:1783969449.898605:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272196480 00000100:00100000:2.0:1783969449.898667:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 144 00000100:00100000:2.0:1783969449.898692:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+17:11340:x1870627272196480:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783969449.898718:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969449.898738:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098a00/0xbacf56d076fab720 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63317 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969449.898849:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1783969449.899000:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098a00/0xbacf56d076fab720 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63317 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.899015:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac785336e00) 00010000:00010000:2.0:1783969449.899018:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783969449.899022:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098a00/0xbacf56d076fab720 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63317 expref: 19 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969449.899036:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786098a00, rc 0) 00000100:00100000:2.0:1783969449.899193:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+18:11340:x1870627272196480:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 503us (692us total) trans 4294967420 rc 301/301 00000100:00100000:2.0:1783969449.899200:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 144 00000100:00100000:1.0:1783969449.901613:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969449.902319:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272196736 00000100:00100000:0.0:1783969449.902330:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272196736 00000100:00100000:0.0:1783969449.902473:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 37 00000100:00100000:0.0:1783969449.902484:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+18:11340:x1870627272196736:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1783969449.902752:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+19:11340:x1870627272196736:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 269us (1147us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1783969449.902761:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 37 00000100:00100000:1.0:1783969449.980433:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969449.980921:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272196864 00000100:00100000:0.0:1783969449.980933:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272196864 00000100:00100000:0.0:1783969449.981001:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 145 00000100:00100000:0.0:1783969449.981018:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+19:11346:x1870627272196864:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783969449.981053:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969449.981075:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab72e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6331e expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.981139:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab735 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.981153:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.981167:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969449.981225:0:6618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1783969449.981228:0:6618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783969449.981251:0:6618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab735 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.981275:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab72e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6331e expref: 21 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.981293:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab735 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6331e expref: 20 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969449.981302:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:0.0:1783969449.981305:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783969449.981308:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92600, rc 0) 00000100:00100000:0.0:1783969449.981383:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+20:11346:x1870627272196864:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 367us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969449.981391:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 145 00000100:00100000:1.0:1783969449.995616:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969449.998554:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272197120 00000100:00100000:3.0:1783969449.998568:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272197120 00000100:00100000:3.0:1783969449.998721:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 146 00000100:00100000:3.0:1783969449.998733:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+20:11346:x1870627272197120:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783969449.998752:0:10288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969449.998779:0:10288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab73c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63325 expref: -99 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969449.998903:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab743 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969449.998917:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969449.998929:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969449.998940:0:10288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783969449.999072:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab73c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63325 expref: 23 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.000451:0:10288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab743 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63325 expref: 22 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.000461:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac790086300) 00010000:00010000:3.0:1783969450.000464:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783969450.000467:0:10288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7800, rc 0) 00000100:00100000:3.0:1783969450.000563:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+22:11346:x1870627272197120:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1832us (4955us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1783969450.000572:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 146 00000100:00100000:1.0:1783969450.007273:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969450.007339:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969450.007476:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272197376 00000100:00100000:2.0:1783969450.007485:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272197376 00000100:00100000:2.0:1783969450.007546:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 147 00000100:00100000:2.0:1783969450.007556:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+22:11346:x1870627272197376:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783969450.007580:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969450.007599:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098a00/0xbacf56d076fab751 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6332c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.007701:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fab758 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.007733:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fab758 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.007745:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fab758 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969450.007759:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783969450.007910:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098a00/0xbacf56d076fab751 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6332c expref: 25 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.007928:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fab758 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6332c expref: 24 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.007935:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac790086300) 00010000:00010000:2.0:1783969450.007938:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783969450.007942:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786098400, rc 0) 00000100:00100000:2.0:1783969450.007992:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+24:11346:x1870627272197376:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 438us (728us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1783969450.008000:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 147 00000100:00100000:3.0:1783969450.008298:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272197504 00000100:00100000:3.0:1783969450.008303:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272197504 00000100:00100000:3.0:1783969450.008364:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:3.0:1783969450.008372:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1666d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03985e57-ffb4-414b-b30c-e72697857d4f+24:2349:x1870627272197504:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969450.008381:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969450.008396:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab743 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63325 expref: 24 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.008407:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac790086300) 00010000:00010000:3.0:1783969450.008411:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969450.008432:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1666d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03985e57-ffb4-414b-b30c-e72697857d4f+23:2349:x1870627272197504:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 61us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969450.008439:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:1.0:1783969450.018739:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969450.018836:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272197632 00000100:00100000:2.0:1783969450.018845:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272197632 00000100:00100000:2.0:1783969450.018955:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 49 00000100:00100000:2.0:1783969450.018966:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+6:2350:x1870627272197632:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:2.0:1783969450.019010:0:6594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009219ae06/0xbacf56d076fab766 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.019030:0:6594:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000069e02287/0xbacf56d076fab719 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63310 expref: 6 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.019052:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1783969450.019057:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783969450.019061:0:6594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009219ae06/0xbacf56d076fab766 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.019109:0:6594:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000069e02287/0xbacf56d076fab719 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63310 expref: 6 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.019129:0:6594:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000069e02287/0xbacf56d076fab719 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63310 expref: 6 pid: 6593 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969450.019340:0:6594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac782fb3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6594:1870627280589568:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783969450.019625:0:6594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bf56e240 going to sleep for 11 seconds 00000100:00080000:0.0:1783969450.019700:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969450.027664:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969450.027821:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272197760 00000100:00100000:0.0:1783969450.027905:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272197760 00002000:00100000:0.0:1783969450.027952:0:6600:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9ac7c1664a80 x1870627272197760/t0(0) o4->03985e57-ffb4-414b-b30c-e72697857d4f@192.168.203.39@tcp:346/0 lens 504/0 e 0 to 0 dl 1783969461 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783969450.027963:0:6600:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac7c1664a80 with x1870627272197760 ext(0->12) 00010000:00010000:0.0:1783969450.027972:0:6600:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000069e02287/0xbacf56d076fab719 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63310 expref: 7 pid: 6593 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.027989:0:6600:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000069e02287/0xbacf56d076fab719 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63310 expref: 7 pid: 6593 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783969450.027997:0:6600:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ac7c1664a80 00000100:00100000:2.0:1783969450.028405:0:6594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac782fb3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6594:1870627280589568:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969450.028430:0:6594:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009219ae06/0xbacf56d076fab766 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969450.029537:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00100000:3.0:1783969450.029554:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:03985e57-ffb4-414b-b30c-e72697857d4f+7:2351:x1870627272197760:12345-192.168.203.39@tcp:4:lfs.0 00000100:00100000:3.0:1783969450.031656:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:03985e57-ffb4-414b-b30c-e72697857d4f+9:2351:x1870627272197760:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 2099us (3991us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1783969450.031668:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2 00002000:00100000:3.0:1783969450.031679:0:6599:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9ac7c1664a80 x1870627272197760/t4294967305(0) o4->03985e57-ffb4-414b-b30c-e72697857d4f@192.168.203.39@tcp:346/0 lens 504/448 e 0 to 0 dl 1783969461 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783969450.031690:0:6599:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac7c1664a80 with x1870627272197760 ext(0->12) 00010000:00010000:3.0:1783969450.031698:0:6599:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000069e02287/0xbacf56d076fab719 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63310 expref: 9 pid: 6593 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.031724:0:6599:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000069e02287/0xbacf56d076fab719 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63310 expref: 9 pid: 6593 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783969450.031732:0:6599:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ac7c1664a80 00000100:00100000:1.0:1783969450.035633:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969450.035968:0:8304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272197888 00000100:00100000:0.0:1783969450.035978:0:8304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272197888 00010000:00010000:0.0:1783969450.036014:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000069e02287/0xbacf56d076fab719 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63310 expref: 9 pid: 6593 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969450.036336:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 64 00000100:00100000:0.0:1783969450.036346:0:8304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1667800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+9:2351:x1870627272197888:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969450.036377:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783969450.036397:0:8304:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783969450.036400:0:8304:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783969449 00002000:00010000:0.0:1783969450.036403:0:8304:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783969450 00002000:00010000:0.0:1783969450.036405:0:8304:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1783969449 00010000:00010000:0.0:1783969450.036421:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000069e02287/0xbacf56d076fab719 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63310 expref: 9 pid: 6593 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.036456:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000069e02287/0xbacf56d076fab719 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63310 expref: 9 pid: 6593 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.036482:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069e02287/0xbacf56d076fab719 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63310 expref: 9 pid: 6593 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.036498:0:8304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783969450.036503:0:8304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783969450.036509:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009219ae06/0xbacf56d076fab766 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.036518:0:8304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009219ae06/0xbacf56d076fab766 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.036557:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969450.036613:0:8304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1667800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+8:2351:x1870627272197888:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 268us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969450.036622:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 64 00010000:00010000:1.0:1783969450.036886:0:6594:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009219ae06/0xbacf56d076fab766 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.036908:0:6594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009219ae06/0xbacf56d076fab766 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.036932:0:6594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009219ae06/0xbacf56d076fab766 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.036941:0:6594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009219ae06/0xbacf56d076fab766 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.036948:0:6594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009219ae06/0xbacf56d076fab766 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.036956:0:6594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786098a00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969450.036961:0:6594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009219ae06/0xbacf56d076fab766 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.036969:0:6594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009219ae06/0xbacf56d076fab766 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.036981:0:6594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009219ae06/0xbacf56d076fab766 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.036988:0:6594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009219ae06/0xbacf56d076fab766 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969450.037066:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+7:2350:x1870627272197632:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 18102us (18336us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969450.037074:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 49 00000100:00100000:1.0:1783969450.047459:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969450.047539:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272198144 00000100:00100000:3.0:1783969450.047549:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272198144 00000100:00100000:3.0:1783969450.047599:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 38 00000100:00100000:3.0:1783969450.047609:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786071050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+23:11346:x1870627272198144:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:3.0:1783969450.047665:0:5797:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fab758 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6332c expref: 23 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783969450.048007:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1783969450.048054:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1783969450.048571:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:3.0:1783969450.048623:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab76d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.048639:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab704 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63302 expref: 27 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.048648:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab76d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.048680:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab704 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63302 expref: 27 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.048695:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab704 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63302 expref: 27 pid: 5794 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969450.048716:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bfdbea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5797:1870627280589696:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783969450.049297:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfda63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969450.051983:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969450.052038:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bfdbea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5797:1870627280589696:192.168.203.39@tcp:104: 00010000:00010000:1.0:1783969450.052067:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab76d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969450.052134:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272198272 00000100:00100000:0.0:1783969450.052141:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272198272 00010000:00010000:0.0:1783969450.052177:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab704 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63302 expref: 28 pid: 5794 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969450.052214:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 65 00000100:00100000:0.0:1783969450.052224:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a60050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03985e57-ffb4-414b-b30c-e72697857d4f+28:2350:x1870627272198272:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969450.052254:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969450.052261:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab704 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63302 expref: 28 pid: 5794 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.052273:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab704 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63302 expref: 28 pid: 5794 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.052292:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab704 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63302 expref: 28 pid: 5794 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.052305:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac790086300) 00010000:00010000:0.0:1783969450.052309:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab76d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.052317:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab76d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.052323:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab76d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.052351:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969450.052402:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a60050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03985e57-ffb4-414b-b30c-e72697857d4f+27:2350:x1870627272198272:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 180us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969450.052408:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 65 00010000:00010000:1.0:1783969450.052526:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab76d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.052533:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab76d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783969450.052658:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:1.0:1783969450.052975:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1783969450.053085:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1665500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5797:1870627280589824:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783969450.053130:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969450.053164:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa45240 going to sleep for 11 seconds 00000100:00100000:3.0:1783969450.053252:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280589824 00000100:00100000:3.0:1783969450.053258:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280589824 00000100:00100000:3.0:1783969450.053308:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783969450.053316:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1870627280589824:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783969450.053381:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1870627280589824:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 65us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969450.053387:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1783969450.053435:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969450.053488:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1665500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5797:1870627280589824:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1783969450.054094:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1783969450.054153:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1665500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5797:1870627280589952:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783969450.054190:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969450.054301:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa45d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783969450.054336:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280589952 00000100:00100000:3.0:1783969450.054341:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280589952 00000100:00100000:2.0:1783969450.054484:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783969450.054493:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1870627280589952:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783969450.054684:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5797:x1870627280589952:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 191us (492us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1783969450.054691:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783969450.054759:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1665500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5797:1870627280589952:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1783969450.054804:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1783969450.054839:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab76d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.054849:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab76d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.054855:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab76d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.054976:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969450.054981:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab76d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.054999:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab76d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.055014:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac790086300) 00010000:00010000:3.0:1783969450.055017:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1783969450.055022:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab76d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.055028:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab76d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783969450.055192:0:5797:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1783969450.055294:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1783969450.055305:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 307137445272ns, next at 308137443193ns, rc = 0 00000001:00080000:3.0:1783969450.055311:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1783969450.055344:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac790086300) 00010000:00010000:3.0:1783969450.055347:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783969450.055353:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fab758 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6332c expref: 31 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969450.055478:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786071050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+30:11346:x1870627272198144:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 7869us (8026us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1783969450.055486:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 38 00000020:00080000:3.0:1783969450.055490:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1783969450.061639:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969450.061947:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272198400 00000100:00100000:2.0:1783969450.061966:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272198400 00000100:00100000:2.0:1783969450.062029:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 148 00000100:00100000:2.0:1783969450.062039:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bfdbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+30:11346:x1870627272198400:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783969450.062063:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969450.062087:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099000/0xbacf56d076fab774 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63333 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.062148:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099000/0xbacf56d076fab774 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63333 expref: 31 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.062164:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099000/0xbacf56d076fab774 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63333 expref: 31 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.062193:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac785336600) 00010000:00010000:2.0:1783969450.062197:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783969450.062201:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786099000, rc 0) 00000100:00100000:2.0:1783969450.062412:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bfdbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+31:11346:x1870627272198400:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 373us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969450.062420:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 148 00000100:00100000:1.0:1783969450.067434:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969450.068028:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272198656 00000100:00100000:0.0:1783969450.068039:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272198656 00000100:00100000:1.0:1783969450.068304:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 39 00000100:00100000:1.0:1783969450.068328:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+31:11346:x1870627272198656:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1783969450.068570:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+32:11346:x1870627272198656:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 243us (1144us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1783969450.068578:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 39 00000001:00080000:2.0:1783969450.162021:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:2.0:1783969450.162038:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:3.0:1783969450.166829:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969450.167205:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272198912 00000100:00100000:0.0:1783969450.167274:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272198912 00000100:00100000:0.0:1783969450.167376:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 149 00000100:00100000:0.0:1783969450.167387:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bfdbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+32:11356:x1870627272198912:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783969450.167409:0:10288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969450.167430:0:10288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab77b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6333a expref: -99 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969450.167537:0:10288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1783969450.167650:0:10288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab77b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6333a expref: 34 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.167664:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac785336e00) 00010000:00010000:0.0:1783969450.167667:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783969450.167671:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab77b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6333a expref: 34 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.167683:0:10288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93000, rc 0) 00000100:00100000:0.0:1783969450.167795:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bfdbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+33:11356:x1870627272198912:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 409us (973us total) trans 4294967434 rc 301/301 00000100:00100000:0.0:1783969450.167801:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 149 00000100:00100000:0.0:1783969450.170924:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969450.171114:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272199040 00000100:00100000:1.0:1783969450.171123:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272199040 00000100:00100000:1.0:1783969450.171177:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 150 00000100:00100000:1.0:1783969450.171194:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+33:11356:x1870627272199040:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:1.0:1783969450.171264:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fab789 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171281:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fab789 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171293:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fab789 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171308:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076fab790 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171315:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076fab790 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171322:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076fab790 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171409:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab797 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171417:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab797 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171439:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab797 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783969450.171475:0:6618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab797 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171486:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fab789 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171491:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fab789 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171497:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fab789 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171502:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60f800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969450.171506:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fab789 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171513:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fab789 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171523:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:1.0:1783969450.171526:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969450.171531:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fab789 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171536:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fab789 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171547:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076fab790 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171558:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076fab790 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171563:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076fab790 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171568:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60fc00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969450.171570:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076fab790 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171576:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076fab790 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171584:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ac7829e0000) 00010000:00010000:1.0:1783969450.171587:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969450.171589:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076fab790 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171595:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fc00/0xbacf56d076fab790 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171609:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab797 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171615:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab797 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171620:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab797 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171624:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60ec00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969450.171633:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab797 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171640:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab797 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171648:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac785336600) 00010000:00010000:1.0:1783969450.171650:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969450.171653:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab797 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969450.171659:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab797 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969450.172041:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+33:11356:x1870627272199040:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 847us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969450.172049:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 150 00000100:00100000:1.0:1783969450.175074:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969450.175170:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272199296 00000100:00100000:3.0:1783969450.175180:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272199296 00000100:00100000:3.0:1783969450.175254:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 40 00000100:00100000:3.0:1783969450.175264:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+33:11356:x1870627272199296:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1783969450.175503:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+34:11356:x1870627272199296:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 239us (436us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1783969450.175511:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 40 00000100:00100000:3.0:1783969450.207065:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969450.207454:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272199552 00000100:00100000:2.0:1783969450.207464:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272199552 00000100:00100000:2.0:1783969450.207584:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 151 00000100:00100000:2.0:1783969450.207596:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bfdbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+34:11359:x1870627272199552:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783969450.207624:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969450.207646:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098600/0xbacf56d076fab79e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63341 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.207745:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fab7a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.207758:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fab7a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.207769:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fab7a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.207783:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab7ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.207790:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab7ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.207797:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab7ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.207968:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098200/0xbacf56d076fab7b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.207977:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098200/0xbacf56d076fab7b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.207985:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098200/0xbacf56d076fab7b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969450.207994:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783969450.208089:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fab7a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.208097:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fab7a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.208110:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fab7a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.208116:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786099600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969450.208121:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fab7a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.208128:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fab7a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.208140:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:2.0:1783969450.208143:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969450.208146:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fab7a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.208152:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fab7a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.208165:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab7ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.208171:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab7ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.208176:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab7ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.208180:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786098e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969450.208183:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab7ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.208199:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab7ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.208208:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ac785336700) 00010000:00010000:2.0:1783969450.208211:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969450.208213:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab7ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.208218:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab7ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.208269:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098600/0xbacf56d076fab79e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63341 expref: 37 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.208283:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098200/0xbacf56d076fab7b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63341 expref: 36 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.208291:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac785336600) 00010000:00010000:2.0:1783969450.208293:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783969450.208295:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786098200, rc 0) 00000100:00100000:2.0:1783969450.208348:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bfdbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+36:11359:x1870627272199552:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 755us (1295us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1783969450.208355:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 151 00000100:00100000:0.0:1783969450.211807:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969450.211940:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272199680 00000100:00100000:3.0:1783969450.211949:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272199680 00000100:00100000:3.0:1783969450.212001:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 152 00000100:00100000:3.0:1783969450.212009:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+36:11359:x1870627272199680:12345-192.168.203.39@tcp:54:lfs.0 00010000:00010000:3.0:1783969450.212068:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab7c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.212085:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab7c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.212096:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab7c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.212123:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab7c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.212129:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab7c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.212136:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab7c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.212142:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969450.212146:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab7c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.212165:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab7c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.212175:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac785336600) 00010000:00010000:3.0:1783969450.212178:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783969450.212182:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab7c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.212188:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab7c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969450.212269:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+36:11359:x1870627272199680:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 260us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969450.212277:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 152 00000100:00100000:1.0:1783969450.214475:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969450.214546:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272199936 00000100:00100000:3.0:1783969450.214554:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272199936 00000100:00100000:3.0:1783969450.214624:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 41 00000100:00100000:3.0:1783969450.214633:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+36:11359:x1870627272199936:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:3.0:1783969450.214845:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+37:11359:x1870627272199936:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 211us (376us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1783969450.214853:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 41 00000100:00100000:1.0:1783969450.459997:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969450.460076:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272200192 00000100:00100000:0.0:1783969450.460085:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272200192 00000100:00100000:0.0:1783969450.460142:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 153 00000100:00100000:0.0:1783969450.460149:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+37:11390:x1870627272200192:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:0.0:1783969450.460168:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969450.460185:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab7c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63348 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.460293:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab7cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.460305:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab7cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.460313:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab7cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969450.460322:0:6618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1783969450.460435:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab7c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63348 expref: 40 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.460453:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab7cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63348 expref: 39 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.460462:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac785336600) 00010000:00010000:0.0:1783969450.460464:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969450.460467:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93800, rc 0) 00000100:00100000:0.0:1783969450.460521:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+39:11390:x1870627272200192:12345-192.168.203.39@tcp:101:cat.0 Request processed in 372us (535us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1783969450.460526:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 153 00000100:00100000:0.0:1783969450.466905:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969450.466984:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969450.467057:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272200576 00000100:00100000:2.0:1783969450.467066:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272200576 00000100:00100000:2.0:1783969450.467133:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:2.0:1783969450.467143:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+39:2348:x1870627272200576:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969450.467178:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969450.467201:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab7cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63348 expref: 39 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.467219:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac785336600) 00010000:00010000:2.0:1783969450.467224:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969450.467281:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+38:2348:x1870627272200576:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 140us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969450.467289:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:1.0:1783969450.467353:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272200448 00000100:00100000:1.0:1783969450.467358:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272200448 00000100:00100000:1.0:1783969450.467397:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 42 00000100:00100000:1.0:1783969450.467405:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+38:11390:x1870627272200448:12345-192.168.203.39@tcp:35:cat.0 00000100:00100000:1.0:1783969450.470932:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+39:11390:x1870627272200448:12345-192.168.203.39@tcp:35:cat.0 Request processed in 3516us (4024us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1783969450.470947:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 42 00000100:00100000:0.0:1783969450.529850:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969450.529993:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272200832 00000100:00100000:2.0:1783969450.530001:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272200832 00000100:00100000:2.0:1783969450.530081:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 154 00000100:00100000:2.0:1783969450.530090:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+39:11396:x1870627272200832:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1783969450.530112:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969450.530115:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783969450.530137:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab735 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6331e expref: 39 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.530153:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:2.0:1783969450.530157:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783969450.530167:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098600/0xbacf56d076fab7dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6334f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.530254:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab7e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.530265:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098200/0xbacf56d076fab7b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63341 expref: 39 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.530286:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab7e4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.530313:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098200/0xbacf56d076fab7b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63341 expref: 39 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.530324:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098200/0xbacf56d076fab7b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63341 expref: 39 pid: 5794 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969450.530335:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac782fb3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5794:1870627280590080:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783969450.530483:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bf56ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1783969450.533261:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969450.533560:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272200960 00000100:00100000:0.0:1783969450.533569:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272200960 00000100:00100000:2.0:1783969450.533593:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac782fb3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5794:1870627280590080:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783969450.533616:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098200/0xbacf56d076fab7b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63341 expref: 40 pid: 5794 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.533620:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab7e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969450.533669:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 66 00000100:00100000:0.0:1783969450.533680:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bfdbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03985e57-ffb4-414b-b30c-e72697857d4f+40:2350:x1870627272200960:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969450.533695:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969450.533703:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098200/0xbacf56d076fab7b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63341 expref: 40 pid: 5794 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.533723:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098200/0xbacf56d076fab7b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63341 expref: 40 pid: 5794 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.533742:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098200/0xbacf56d076fab7b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63341 expref: 40 pid: 5794 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.533756:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac785336600) 00010000:00010000:0.0:1783969450.533760:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab7e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.533768:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab7e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.533776:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab7e4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.533801:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969450.533925:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bfdbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03985e57-ffb4-414b-b30c-e72697857d4f+39:2350:x1870627272200960:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 246us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969450.533934:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 66 00010000:00010000:2.0:1783969450.533995:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab7e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.534004:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab7e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969450.534022:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1783969450.534376:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969450.534388:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098600/0xbacf56d076fab7dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6334f expref: 40 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.534405:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab7e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6334f expref: 39 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.534425:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac785336600) 00010000:00010000:2.0:1783969450.534428:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783969450.534430:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786098e00, rc 0) 00000100:00100000:2.0:1783969450.534461:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+39:11396:x1870627272200832:12345-192.168.203.39@tcp:101:dd.0 Request processed in 4371us (4621us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1783969450.534468:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 154 00000100:00100000:3.0:1783969450.538246:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969450.538292:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272201216 00000100:00100000:2.0:1783969450.538302:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272201216 00000100:00100000:2.0:1783969450.538362:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 155 00000100:00100000:2.0:1783969450.538372:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bfdbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+39:11396:x1870627272201216:12345-192.168.203.39@tcp:36:dd.0 00010000:00010000:2.0:1783969450.538610:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fab7f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.538627:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fab7f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.538644:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fab7f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783969450.538691:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:2.0:1783969450.538716:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003ca2f34f reply state 00000000525c186d transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fab7f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969450.538725:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783969450.538805:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bfdbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+42:11396:x1870627272201216:12345-192.168.203.39@tcp:36:dd.0 Request processed in 434us (567us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1783969450.538812:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 155 00000020:00080000:2.0:1783969450.538830:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783969450.541302:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fab7f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.541317:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fab7f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.541324:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fab7f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.541331:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786099600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969450.541335:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fab7f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.541342:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fab7f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.541357:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac785336600) 00010000:00010000:2.0:1783969450.541360:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969450.541365:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fab7f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.541371:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fab7f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969450.892616:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969450.892899:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272201344 00000100:00100000:2.0:1783969450.892908:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272201344 00000100:00100000:2.0:1783969450.892968:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 156 00000100:00100000:2.0:1783969450.892979:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bfdbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+41:11410:x1870627272201344:12345-192.168.203.39@tcp:101:stat.0 00010000:00010000:2.0:1783969450.893001:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969450.893022:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fab7f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63356 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.893303:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098600/0xbacf56d076fab800 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.893317:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098600/0xbacf56d076fab800 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.893331:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098600/0xbacf56d076fab800 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.893349:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099e00/0xbacf56d076fab807 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.893356:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099e00/0xbacf56d076fab807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.893366:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099e00/0xbacf56d076fab807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.893476:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab80e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.893488:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab7e4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6334f expref: 42 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.893495:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab80e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.893531:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab7e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6334f expref: 42 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.893561:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab7e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6334f expref: 42 pid: 5794 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969450.893574:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac782fb3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1870627280590208:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783969450.893668:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bf56e780 going to sleep for 11 seconds 00000100:00100000:0.0:1783969450.901659:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969450.901754:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272201600 00000100:00100000:3.0:1783969450.901763:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272201600 00000100:00100000:3.0:1783969450.901819:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 43 00000100:00100000:3.0:1783969450.901829:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+43:5578:x1870627272201600:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783969450.902286:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+44:5578:x1870627272201600:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 345us (523us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1783969450.902296:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 43 00000100:00100000:2.0:1783969450.902684:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac782fb3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1870627280590208:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969450.902706:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab80e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969450.907770:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969450.907905:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272201728 00000100:00100000:2.0:1783969450.907925:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272201728 00010000:00010000:2.0:1783969450.907968:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab7e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6334f expref: 44 pid: 5794 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969450.908056:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 67 00000100:00100000:2.0:1783969450.908067:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1666300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+44:2351:x1870627272201728:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969450.908081:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969450.908088:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab7e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6334f expref: 44 pid: 5794 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.908101:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab7e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6334f expref: 44 pid: 5794 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.908123:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab7e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6334f expref: 44 pid: 5794 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.908150:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac785336600) 00010000:00010000:2.0:1783969450.908155:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab80e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.908164:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab80e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.908172:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab80e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.908208:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969450.908268:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1666300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+43:2351:x1870627272201728:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 202us (509us total) trans 0 rc 0/0 00010000:00010000:3.0:1783969450.908276:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab80e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969450.908276:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 67 00010000:00010000:3.0:1783969450.908288:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab80e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969450.908332:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1783969450.908336:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783969450.908361:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab80e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.908386:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab80e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.908397:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098600/0xbacf56d076fab800 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.908404:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098600/0xbacf56d076fab800 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.908411:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098600/0xbacf56d076fab800 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.908418:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786098600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969450.908422:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098600/0xbacf56d076fab800 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.908429:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098600/0xbacf56d076fab800 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.908447:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:3.0:1783969450.908450:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969450.908453:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098600/0xbacf56d076fab800 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.908458:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098600/0xbacf56d076fab800 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.908468:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099e00/0xbacf56d076fab807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.908474:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099e00/0xbacf56d076fab807 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.908478:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099e00/0xbacf56d076fab807 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.908483:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786099e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969450.908485:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099e00/0xbacf56d076fab807 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.908490:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099e00/0xbacf56d076fab807 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.908497:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ac785336700) 00010000:00010000:3.0:1783969450.908499:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969450.908501:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099e00/0xbacf56d076fab807 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.908506:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099e00/0xbacf56d076fab807 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.908550:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fab7f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63356 expref: 43 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.908564:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab80e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63356 expref: 42 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969450.908572:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac785336600) 00010000:00010000:3.0:1783969450.908574:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783969450.908577:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786098000, rc 0) 00000100:00100000:3.0:1783969450.909199:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bfdbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+42:11410:x1870627272201344:12345-192.168.203.39@tcp:101:stat.0 Request processed in 16219us (16591us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969450.909208:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 156 00000100:00100000:1.0:1783969450.978150:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969450.978640:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272201984 00000100:00100000:2.0:1783969450.978651:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272201984 00000100:00100000:2.0:1783969450.978719:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 157 00000100:00100000:2.0:1783969450.978730:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+42:11415:x1870627272201984:12345-192.168.203.39@tcp:36:truncate.0 00010000:00010000:2.0:1783969450.978807:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969450.978836:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab80e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63356 expref: 42 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.978854:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac785336600) 00010000:00010000:2.0:1783969450.978918:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783969450.979130:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab815 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.979145:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab815 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969450.979164:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab815 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783969450.979217:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:2.0:1783969450.979241:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000a02af20 reply state 00000000040b35d7 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab815 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969450.979250:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783969450.979353:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+44:11415:x1870627272201984:12345-192.168.203.39@tcp:36:truncate.0 Request processed in 624us (1213us total) trans 4294967445 rc 0/0 00000100:00100000:2.0:1783969450.979361:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 157 00000020:00080000:2.0:1783969450.979366:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783969450.983085:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab815 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.983113:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab815 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.983120:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab815 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.983126:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786098e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969450.983131:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab815 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.983139:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab815 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.983155:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac785336600) 00010000:00010000:0.0:1783969450.983158:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969450.983162:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab815 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969450.983168:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fab815 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969451.146762:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969451.148608:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272202112 00000100:00100000:0.0:1783969451.148621:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272202112 00000100:00100000:0.0:1783969451.148715:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 158 00000100:00100000:0.0:1783969451.148726:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+43:11430:x1870627272202112:12345-192.168.203.39@tcp:101:stat.0 00010000:00010000:0.0:1783969451.148748:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969451.148769:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab81c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6335d expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.148908:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab823 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.148925:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab823 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.148938:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab823 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.148966:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab82a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.148974:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab82a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.148982:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab82a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.149084:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab831 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.149093:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.149102:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969451.149137:0:6618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1783969451.149141:0:6618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783969451.149159:0:6618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.149181:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.149189:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab823 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.149195:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab823 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.149200:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab823 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.149205:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969451.149210:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab823 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.149216:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab823 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.149228:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:0.0:1783969451.149231:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969451.149235:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab823 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.149242:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab823 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.149255:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab82a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.149260:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab82a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.149272:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab82a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.149278:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969451.149281:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab82a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.149287:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab82a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.149295:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ac790086900) 00010000:00010000:0.0:1783969451.149298:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969451.149301:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab82a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.149306:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab82a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.149338:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab81c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6335d expref: 45 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.149353:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab831 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6335d expref: 44 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.149361:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac785336600) 00010000:00010000:0.0:1783969451.149363:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969451.149366:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92400, rc 0) 00000100:00100000:0.0:1783969451.149454:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+44:11430:x1870627272202112:12345-192.168.203.39@tcp:101:stat.0 Request processed in 720us (2689us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969451.149470:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 158 00000100:00080000:2.0:1783969451.149742:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969451.238636:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969451.238729:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272202368 00000100:00100000:3.0:1783969451.238738:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272202368 00000100:00100000:3.0:1783969451.238796:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 159 00000100:00100000:3.0:1783969451.238806:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+44:11440:x1870627272202368:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783969451.238824:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969451.238844:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab838 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63364 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969451.239157:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1783969451.239268:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab838 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63364 expref: 46 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969451.239283:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac785336e00) 00010000:00010000:3.0:1783969451.239286:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783969451.239297:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab838 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63364 expref: 46 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969451.239310:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7800, rc 0) 00000100:00100000:3.0:1783969451.239365:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+45:11440:x1870627272202368:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 561us (739us total) trans 4294967446 rc 301/301 00000100:00100000:3.0:1783969451.239373:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 159 00000100:00100000:3.0:1783969451.242723:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969451.242817:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272202624 00000100:00100000:1.0:1783969451.242825:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272202624 00000100:00100000:1.0:1783969451.242931:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 44 00000100:00100000:1.0:1783969451.242941:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786071c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+45:11440:x1870627272202624:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1783969451.243385:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786071c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+46:11440:x1870627272202624:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 444us (669us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1783969451.243394:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 44 00000100:00100000:1.0:1783969451.301543:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969451.302139:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272202880 00000100:00100000:0.0:1783969451.302150:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272202880 00000100:00100000:0.0:1783969451.302226:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 160 00000100:00100000:0.0:1783969451.302236:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+46:11446:x1870627272202880:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:0.0:1783969451.302259:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969451.302281:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab846 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6336b expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.302374:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab84d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.302389:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab831 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6335d expref: 47 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.302397:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab84d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.302429:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab831 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6335d expref: 47 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.302601:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab831 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6335d expref: 47 pid: 6618 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969451.302617:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1b9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1870627280590336:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783969451.302705:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac791f79240 going to sleep for 11 seconds 00000100:00100000:0.0:1783969451.308517:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969451.308697:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272203008 00000100:00100000:3.0:1783969451.308706:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272203008 00010000:00010000:3.0:1783969451.308747:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab831 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6335d expref: 48 pid: 6618 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969451.308789:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 68 00000100:00100000:3.0:1783969451.308800:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+48:2350:x1870627272203008:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969451.308814:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969451.308821:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab831 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6335d expref: 48 pid: 6618 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969451.308834:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab831 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6335d expref: 48 pid: 6618 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969451.308855:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac785336600) 00010000:00010000:3.0:1783969451.308900:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab84d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969451.308910:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab84d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969451.308929:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab84d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969451.308948:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969451.309014:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+48:2350:x1870627272203008:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 215us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969451.309022:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 68 00010000:00010000:2.0:1783969451.309742:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab831 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6335d expref: 47 pid: 6618 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969451.309760:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1b9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1870627280590336:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969451.309781:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab84d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.309789:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab84d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.309794:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab84d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969451.309811:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1783969451.310201:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab846 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6336b expref: 48 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.310235:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab84d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6336b expref: 47 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.310244:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac785336600) 00010000:00010000:2.0:1783969451.310247:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783969451.310249:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92600, rc 0) 00000100:00100000:2.0:1783969451.310298:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+47:11446:x1870627272202880:12345-192.168.203.39@tcp:101:bash.0 Request processed in 8063us (8764us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1783969451.310305:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 160 00000100:00100000:0.0:1783969451.324108:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969451.324218:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272203264 00000100:00100000:1.0:1783969451.324227:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272203264 00000100:00100000:1.0:1783969451.324287:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 161 00000100:00100000:1.0:1783969451.324297:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+47:11446:x1870627272203264:12345-192.168.203.39@tcp:36:bash.0 00010000:00010000:1.0:1783969451.324542:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab85b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.324560:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab85b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.324572:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab85b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783969451.324622:0:6618:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:1.0:1783969451.324645:0:6618:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009c7fa2f9 reply state 00000000ddbd94c6 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab85b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969451.324654:0:6618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783969451.324963:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+50:11446:x1870627272203264:12345-192.168.203.39@tcp:36:bash.0 Request processed in 666us (862us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1783969451.324971:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 161 00000020:00080000:1.0:1783969451.324977:0:6618:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783969451.329305:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:2.0:1783969451.329514:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab85b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.329526:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab85b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.329534:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab85b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.329540:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60e200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969451.329545:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab85b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.329552:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab85b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.329568:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac785336600) 00010000:00010000:2.0:1783969451.329571:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969451.329575:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab85b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.329596:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fab85b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969451.329673:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272203392 00000100:00100000:0.0:1783969451.329683:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272203392 00000100:00100000:0.0:1783969451.329730:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 162 00000100:00100000:0.0:1783969451.329740:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bfdbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+49:11446:x1870627272203392:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:0.0:1783969451.329760:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969451.329777:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab862 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63372 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.329851:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab869 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.329911:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab84d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6336b expref: 50 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.329921:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab869 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.329954:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab84d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6336b expref: 50 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.329968:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab84d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6336b expref: 50 pid: 5795 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969451.329981:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1b99c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5794:1870627280590464:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783969451.330062:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac791f79240 going to sleep for 11 seconds 00000100:00100000:0.0:1783969451.340544:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1b99c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5794:1870627280590464:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783969451.340577:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab869 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969451.348253:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969451.348505:0:8304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272203520 00000100:00100000:0.0:1783969451.348515:0:8304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272203520 00010000:00010000:0.0:1783969451.348553:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab84d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6336b expref: 51 pid: 5795 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969451.348598:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 69 00000100:00100000:0.0:1783969451.348608:0:8304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bfdbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+51:2350:x1870627272203520:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969451.348624:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969451.348631:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab84d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6336b expref: 51 pid: 5795 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.348645:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab84d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6336b expref: 51 pid: 5795 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.348666:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab84d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6336b expref: 51 pid: 5795 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.348682:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac785336600) 00010000:00010000:0.0:1783969451.348687:0:8304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab869 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.348697:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.348704:0:8304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab869 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.348742:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969451.348805:0:8304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bfdbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+50:2350:x1870627272203520:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 198us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969451.348813:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 69 00010000:00010000:1.0:1783969451.349511:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.349523:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969451.349565:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1783969451.349570:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783969451.349590:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.349620:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab862 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63372 expref: 50 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.349636:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab869 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63372 expref: 49 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.349644:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac785336600) 00010000:00010000:1.0:1783969451.349646:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783969451.349649:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93e00, rc 0) 00000100:00100000:1.0:1783969451.349694:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bfdbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+49:11446:x1870627272203392:12345-192.168.203.39@tcp:101:bash.0 Request processed in 19955us (20397us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969451.349701:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 162 00000100:00100000:3.0:1783969451.353940:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969451.354036:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272203776 00000100:00100000:2.0:1783969451.354045:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272203776 00000100:00100000:2.0:1783969451.354100:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 45 00000100:00100000:2.0:1783969451.354110:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bfdbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+49:11446:x1870627272203776:12345-192.168.203.39@tcp:35:bash.0 00000100:00100000:2.0:1783969451.354342:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bfdbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+50:11446:x1870627272203776:12345-192.168.203.39@tcp:35:bash.0 Request processed in 232us (411us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1783969451.354349:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 45 00000100:00100000:3.0:1783969451.475279:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969451.475365:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272204032 00000100:00100000:2.0:1783969451.475375:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272204032 00000100:00100000:2.0:1783969451.475430:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 163 00000100:00100000:2.0:1783969451.475440:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bfdbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+50:11456:x1870627272204032:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783969451.475463:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969451.475482:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab870 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63379 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969451.475598:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1783969451.475727:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab870 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63379 expref: 52 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.475741:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac785336e00) 00010000:00010000:2.0:1783969451.475744:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783969451.475748:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab870 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63379 expref: 52 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.475778:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786098000, rc 0) 00000100:00100000:2.0:1783969451.475844:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bfdbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+51:11456:x1870627272204032:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 405us (574us total) trans 4294967452 rc 301/301 00000100:00100000:2.0:1783969451.475852:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 163 00000100:00100000:3.0:1783969451.481645:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969451.481762:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272204160 00000100:00100000:1.0:1783969451.481772:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272204160 00000100:00100000:1.0:1783969451.481833:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 164 00000100:00100000:1.0:1783969451.481903:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bfdbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+51:11456:x1870627272204160:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:1.0:1783969451.481977:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab87e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.481993:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab87e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482004:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab87e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482017:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab885 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482024:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab885 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482029:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab885 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482121:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab88c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482130:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab88c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482137:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab88c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783969451.482183:0:6618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab88c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482195:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab87e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482207:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab87e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482214:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab87e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482220:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60fe00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969451.482225:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab87e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482232:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab87e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482244:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:1.0:1783969451.482247:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969451.482252:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab87e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482257:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab87e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482270:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab885 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482276:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab885 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482281:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab885 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482286:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60e000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969451.482294:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab885 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482300:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab885 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482307:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ac7829e0000) 00010000:00010000:1.0:1783969451.482310:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969451.482313:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab885 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482318:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab885 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482332:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab88c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482337:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab88c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482343:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab88c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482347:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60f400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969451.482350:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab88c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482356:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab88c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482362:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac785336600) 00010000:00010000:1.0:1783969451.482364:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969451.482373:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab88c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.482379:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab88c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969451.482502:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bfdbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+51:11456:x1870627272204160:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 643us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969451.482510:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 164 00000100:00100000:1.0:1783969451.487201:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969451.487373:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272204416 00000100:00100000:2.0:1783969451.487383:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272204416 00000100:00100000:2.0:1783969451.487439:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 46 00000100:00100000:2.0:1783969451.487449:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+51:11456:x1870627272204416:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1783969451.487701:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+52:11456:x1870627272204416:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 252us (516us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1783969451.487835:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 46 00000100:00100000:2.0:1783969451.540857:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969451.541039:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272204672 00000100:00100000:1.0:1783969451.541049:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272204672 00000100:00100000:1.0:1783969451.541107:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 165 00000100:00100000:1.0:1783969451.541116:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+52:11459:x1870627272204672:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1783969451.541139:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969451.541161:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab893 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63380 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.541241:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab89a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.541255:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab89a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.541267:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab89a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.541282:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab8a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.541291:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.541312:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.541433:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab8a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.541444:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab8a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.541452:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab8a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969451.541461:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1783969451.541549:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab89a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.541558:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab89a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.541564:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab89a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.541571:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60e000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969451.541576:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab89a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.541584:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab89a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.541596:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:1.0:1783969451.541599:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969451.541609:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab89a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.541616:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab89a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.541630:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab8a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.541637:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab8a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.541643:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab8a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.541648:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60fe00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969451.541651:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab8a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.541658:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab8a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.541666:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ac7829e0000) 00010000:00010000:1.0:1783969451.541668:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969451.541671:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab8a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.541677:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab8a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.541713:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab893 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63380 expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.541738:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab8a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63380 expref: 54 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.541747:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac785336600) 00010000:00010000:1.0:1783969451.541749:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783969451.541752:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bf60f600, rc 0) 00000100:00100000:1.0:1783969451.541817:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+54:11459:x1870627272204672:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 701us (969us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1783969451.541825:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 165 00000100:00100000:3.0:1783969451.545992:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969451.546105:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272204800 00000100:00100000:2.0:1783969451.546113:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272204800 00000100:00100000:2.0:1783969451.546179:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 166 00000100:00100000:2.0:1783969451.546190:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bfdbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+54:11459:x1870627272204800:12345-192.168.203.39@tcp:54:lfs.0 00010000:00010000:2.0:1783969451.546258:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fab8b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.546275:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fab8b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.546287:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fab8b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.546314:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fab8b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.546333:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fab8b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.546340:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fab8b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.546346:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786098800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969451.546350:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fab8b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.546358:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fab8b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.546369:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac785336600) 00010000:00010000:2.0:1783969451.546371:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783969451.546375:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fab8b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.546380:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fab8b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969451.546448:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bfdbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+54:11459:x1870627272204800:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 260us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969451.546455:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 166 00000100:00100000:3.0:1783969451.550688:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969451.550736:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969451.550819:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272205056 00000100:00100000:1.0:1783969451.550828:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272205056 00000100:00100000:1.0:1783969451.550916:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 47 00000100:00100000:1.0:1783969451.550925:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bfdbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+54:11459:x1870627272205056:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1783969451.551137:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bfdbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+55:11459:x1870627272205056:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 213us (458us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1783969451.551144:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 47 00000100:00100000:2.0:1783969451.552440:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272205184 00000100:00100000:2.0:1783969451.552450:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272205184 00000100:00100000:2.0:1783969451.552508:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00100000:2.0:1783969451.552517:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bfdbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+55:2350:x1870627272205184:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969451.552530:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969451.552567:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab8a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63380 expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.552583:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac785336600) 00010000:00010000:2.0:1783969451.552588:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969451.552643:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bfdbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+54:2350:x1870627272205184:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 126us (1905us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969451.552650:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 12 00010000:00010000:2.0:1783969451.557155:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969451.622316:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac782fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280590592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969451.622384:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969451.627262:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280590592 00000100:00100000:2.0:1783969451.627276:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280590592 00000100:00100000:2.0:1783969451.627359:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783969451.627369:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280590592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969451.627404:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783969451.627482:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280590592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (5097us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969451.627489:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783969451.627571:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac782fb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280590592:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783969451.629300:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969451.689229:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969451.689433:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272205440 00000100:00100000:3.0:1783969451.689443:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272205440 00000100:00100000:3.0:1783969451.689503:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 167 00000100:00100000:3.0:1783969451.689513:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+54:11477:x1870627272205440:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:3.0:1783969451.689534:0:10288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969451.689553:0:10288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab8bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63387 expref: -99 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969451.689669:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab8c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969451.689684:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab8c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969451.689695:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab8c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969451.689723:0:10288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1783969451.689851:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab8bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63387 expref: 57 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969451.689910:0:10288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab8c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63387 expref: 56 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969451.689920:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac785336600) 00010000:00010000:3.0:1783969451.689923:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783969451.689927:0:10288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7800, rc 0) 00000100:00100000:3.0:1783969451.690043:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+56:11477:x1870627272205440:12345-192.168.203.39@tcp:101:cat.0 Request processed in 530us (823us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1783969451.690049:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 167 00000100:00100000:3.0:1783969451.714490:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969451.714598:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272205568 00000100:00100000:2.0:1783969451.714610:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272205568 00000100:00100000:2.0:1783969451.714833:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 168 00000100:00100000:2.0:1783969451.714844:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+56:11478:x1870627272205568:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783969451.714905:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969451.714927:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fab8d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6338e expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.714986:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099a00/0xbacf56d076fab8d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.715010:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099a00/0xbacf56d076fab8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.715022:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099a00/0xbacf56d076fab8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969451.715083:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1783969451.715087:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783969451.715107:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099a00/0xbacf56d076fab8d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.715129:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fab8d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6338e expref: 58 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.715145:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099a00/0xbacf56d076fab8d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6338e expref: 57 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969451.715153:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:2.0:1783969451.715155:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783969451.715158:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786099a00, rc 0) 00000100:00100000:2.0:1783969451.715272:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+57:11478:x1870627272205568:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 429us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969451.715279:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 168 00000100:00100000:0.0:1783969451.723588:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969451.725988:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272205952 00000100:00100000:1.0:1783969451.726001:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272205952 00000100:00100000:1.0:1783969451.726136:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 48 00000100:00100000:1.0:1783969451.726146:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+57:11478:x1870627272205952:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1783969451.726488:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+58:11478:x1870627272205952:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 343us (2908us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1783969451.726498:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 48 00000100:00100000:1.0:1783969451.731891:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969451.731944:0:8304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272206080 00000100:00100000:0.0:1783969451.731954:0:8304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272206080 00000100:00100000:0.0:1783969451.732010:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:0.0:1783969451.732020:0:8304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a63050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+58:11478:x1870627272206080:12345-192.168.203.39@tcp:103:lfs.0 00010000:00010000:0.0:1783969451.732036:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783969451.732058:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab869 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63372 expref: 58 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.732076:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab8c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63387 expref: 57 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.732088:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099000/0xbacf56d076fab774 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63333 expref: 56 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969451.732097:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac785336600) 00010000:00010000:0.0:1783969451.732106:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969451.732223:0:8304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a63050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+55:11478:x1870627272206080:12345-192.168.203.39@tcp:103:lfs.0 Request processed in 203us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969451.732231:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:3.0:1783969451.740211:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969451.740322:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272206208 00000100:00100000:1.0:1783969451.740333:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272206208 00000100:00100000:1.0:1783969451.740396:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 169 00000100:00100000:1.0:1783969451.740406:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+55:11478:x1870627272206208:12345-192.168.203.39@tcp:58:lfs.0 00010000:00010000:1.0:1783969451.740537:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab8e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.740553:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab8e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.740566:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab8e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783969451.741469:0:6618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1783969451.741614:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+55:11478:x1870627272206208:12345-192.168.203.39@tcp:58:lfs.0 Request processed in 1207us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969451.741624:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 169 00000100:00100000:3.0:1783969451.766114:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969451.766645:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272206336 00000100:00100000:1.0:1783969451.766655:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272206336 00000100:00100000:1.0:1783969451.766710:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 170 00000100:00100000:1.0:1783969451.766720:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+55:11480:x1870627272206336:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1783969451.766738:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969451.766757:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab8e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63395 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.766822:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab8ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.766834:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab8ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.766856:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab8ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.766913:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab8f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.766920:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab8f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.766927:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab8f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.767013:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fab8fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.767021:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fab8fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.767027:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fab8fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969451.767057:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1783969451.767061:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783969451.767077:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fab8fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.767087:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fab8fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.767095:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab8ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.767110:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab8ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.767116:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab8ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.767122:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60f600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969451.767126:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab8ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.767133:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab8ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.767144:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:1.0:1783969451.767147:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969451.767151:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab8ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.767157:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076fab8ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.767169:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab8f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.767174:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab8f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.767179:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab8f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.767184:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60f400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969451.767192:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab8f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.767199:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab8f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.767206:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ac7829e0f00) 00010000:00010000:1.0:1783969451.767209:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969451.767212:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab8f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.767217:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fab8f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.767245:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076fab8e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63395 expref: 57 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.767258:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fab8fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63395 expref: 56 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969451.767265:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac7829e0000) 00010000:00010000:1.0:1783969451.767267:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783969451.767270:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bf60ea00, rc 0) 00000100:00100000:1.0:1783969451.767338:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+56:11480:x1870627272206336:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 619us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969451.767346:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 170 00000040:00080000:0.0:1783969452.005140:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783969452.005149:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783969452.005448:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1783969452.005456:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783969452.005589:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1b9b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1870627280590720:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783969452.005750:0:11535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac791f79b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783969452.015614:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1b9b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1870627280590720:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783969452.023169:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969452.023563:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272206464 00000100:00100000:0.0:1783969452.023573:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272206464 00000100:00100000:0.0:1783969452.023688:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 171 00000100:00100000:0.0:1783969452.023699:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782fb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+56:11491:x1870627272206464:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783969452.023740:0:5795:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783969452.023846:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782fb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+56:11491:x1870627272206464:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 Request processed in 148us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969452.023853:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 171 00000100:00100000:3.0:1783969452.030624:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969452.030692:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272206592 00000100:00100000:0.0:1783969452.030702:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272206592 00000100:00100000:0.0:1783969452.030783:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 172 00000100:00100000:0.0:1783969452.030794:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+56:11491:x1870627272206592:12345-192.168.203.39@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1783969452.030895:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab903 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.030911:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab903 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.030924:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab903 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.030937:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab90a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.030944:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab90a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.030970:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab90a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.031000:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab911 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.031008:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab911 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.031014:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab911 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969452.031053:0:6618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1783969452.031058:0:6618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783969452.031070:0:6618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab911 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.031203:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab903 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.031212:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab903 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.031219:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab903 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.031225:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969452.031229:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab903 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.031236:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab903 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.031255:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac790086e00) 00010000:00010000:0.0:1783969452.031258:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969452.031262:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab903 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.031268:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab903 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.031282:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab90a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.031287:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab90a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.031292:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab90a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.031298:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969452.031300:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab90a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.031306:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab90a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.031312:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9ac790086900) 00010000:00010000:0.0:1783969452.031314:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969452.031317:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab90a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.031321:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab90a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.031359:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab911 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.031365:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab911 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.031370:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab911 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.031375:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969452.031378:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab911 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.031443:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab911 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.031452:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac7829e0000) 00010000:00010000:0.0:1783969452.031454:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969452.031457:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab911 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.031462:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab911 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969452.031543:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+56:11491:x1870627272206592:12345-192.168.203.39@tcp:34:lhsmtool_posix.0 Request processed in 749us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969452.031552:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 172 00000100:00100000:1.0:1783969452.047714:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969452.047909:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272206848 00000100:00100000:3.0:1783969452.047933:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272206848 00000100:00100000:3.0:1783969452.047996:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 173 00000100:00100000:3.0:1783969452.048008:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+56:11491:x1870627272206848:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969452.048028:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969452.048048:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab918 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6339c expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.048143:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab91f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.048159:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab91f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.048191:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab91f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969452.048204:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1783969452.048295:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab91f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.048304:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab91f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.048311:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab91f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.048317:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de7600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969452.048321:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab91f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.048329:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab91f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.048348:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac7829e0000) 00010000:00010000:3.0:1783969452.048352:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783969452.048356:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab91f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.048363:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab91f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.048402:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab918 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6339c expref: 58 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.048413:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac790086e00) 00010000:00010000:3.0:1783969452.048416:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783969452.048420:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab918 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6339c expref: 58 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.048430:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de6a00, rc 0) 00000100:00100000:3.0:1783969452.048496:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+57:11491:x1870627272206848:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 490us (804us total) trans 4294967458 rc 301/301 00000100:00100000:3.0:1783969452.048504:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 173 00000100:00100000:1.0:1783969452.053401:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969452.054482:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272206976 00000100:00100000:2.0:1783969452.054494:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272206976 00000100:00100000:2.0:1783969452.054552:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 174 00000100:00100000:2.0:1783969452.054562:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+57:11491:x1870627272206976:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783969452.054608:0:5795:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783969452.054733:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+57:11491:x1870627272206976:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 Request processed in 171us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969452.054740:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 174 00000100:00100000:2.0:1783969452.066099:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969452.066391:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272207232 00000100:00100000:0.0:1783969452.066401:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272207232 00000100:00100000:0.0:1783969452.066457:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 175 00000100:00100000:0.0:1783969452.066482:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+57:11491:x1870627272207232:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783969452.066503:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969452.066506:0:6618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783969452.066547:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099a00/0xbacf56d076fab8d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6338e expref: 57 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.066567:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:0.0:1783969452.066572:0:6618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783969452.066589:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab92d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb633a3 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783969452.067134:0:6618:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1783969452.067325:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab934 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.067340:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab934 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.067350:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab934 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.067402:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fab92d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633a3 expref: 59 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.067418:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab934 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633a3 expref: 58 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.067426:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ac790086900) 00010000:00010000:0.0:1783969452.067429:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969452.067441:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92e00, rc 0) 00000100:00100000:0.0:1783969452.067614:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782fb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+58:11491:x1870627272207232:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 1132us (1524us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1783969452.067624:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 175 00000100:00100000:1.0:1783969452.083572:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969452.083922:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272207488 00000100:00100000:3.0:1783969452.083933:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272207488 00000100:00100000:2.0:1783969452.088677:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 176 00000100:00100000:2.0:1783969452.088694:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+58:11491:x1870627272207488:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783969452.088751:0:10288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969452.088780:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab934 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633a3 expref: 58 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.088795:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ac790086900) 00010000:00010000:2.0:1783969452.088807:0:10288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783969452.088826:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098c00/0xbacf56d076fab942 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.088839:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098c00/0xbacf56d076fab942 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.088848:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098c00/0xbacf56d076fab942 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.088941:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099a00/0xbacf56d076fab949 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xe997bc27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.088949:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099a00/0xbacf56d076fab949 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe997bc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.088957:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099a00/0xbacf56d076fab949 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe997bc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.089045:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098c00/0xbacf56d076fab942 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.089053:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098c00/0xbacf56d076fab942 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.089060:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098c00/0xbacf56d076fab942 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.089066:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786098c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969452.089070:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098c00/0xbacf56d076fab942 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.089077:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098c00/0xbacf56d076fab942 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.089087:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:2.0:1783969452.089090:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969452.089094:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098c00/0xbacf56d076fab942 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.089101:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098c00/0xbacf56d076fab942 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.089109:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099a00/0xbacf56d076fab949 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe997bc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.089115:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099a00/0xbacf56d076fab949 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe997bc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.089120:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099a00/0xbacf56d076fab949 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe997bc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.089131:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786099a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969452.089134:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099a00/0xbacf56d076fab949 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe997bc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.089140:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099a00/0xbacf56d076fab949 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe997bc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.089148:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xe997bc27 (ffff9ac785336400) 00010000:00010000:2.0:1783969452.089150:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969452.089153:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099a00/0xbacf56d076fab949 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe997bc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.089158:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099a00/0xbacf56d076fab949 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe997bc27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969452.089247:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+57:11491:x1870627272207488:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 557us (5687us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783969452.089254:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 176 00000100:00100000:2.0:1783969452.092287:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969452.092431:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272207616 00000100:00100000:3.0:1783969452.092441:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272207616 00000100:00100000:3.0:1783969452.092505:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 177 00000100:00100000:3.0:1783969452.092515:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+57:11491:x1870627272207616:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969452.092533:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969452.092563:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab950 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb633aa expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.092599:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab957 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.092612:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab957 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.092624:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab957 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.092728:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab950 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633aa expref: 59 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.092746:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab957 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633aa expref: 58 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.092755:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ac78c550a00) 00010000:00010000:3.0:1783969452.092758:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783969452.092761:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7600, rc 0) 00000100:00100000:3.0:1783969452.092821:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782fb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+58:11491:x1870627272207616:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 308us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969452.092829:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 177 00000100:00100000:1.0:1783969452.108320:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969452.108392:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272207872 00000100:00100000:0.0:1783969452.108402:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272207872 00000100:00100000:0.0:1783969452.108455:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 178 00000100:00100000:0.0:1783969452.108465:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+58:11491:x1870627272207872:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783969452.108557:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab95e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.108573:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab95e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.108584:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab95e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783969452.109056:0:6618:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1783969452.109066:0:6618:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 309191206306ns, next at 310191204122ns, rc = 0 00000004:00010000:0.0:1783969452.109145:0:6618:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000062de8e0e reply state 0000000070ee7368 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab95e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969452.109154:0:6618:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783969452.109247:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+60:11491:x1870627272207872:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 781us (935us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1783969452.109254:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 178 00000100:00100000:0.0:1783969452.113218:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00010000:00010000:2.0:1783969452.113267:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab95e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.113278:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab95e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969452.113280:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272208000 00010000:00010000:2.0:1783969452.113285:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab95e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969452.113289:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272208000 00010000:00010000:2.0:1783969452.113290:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969452.113294:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab95e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.113313:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab95e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.113329:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ac78c550a00) 00010000:00010000:2.0:1783969452.113332:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783969452.113336:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab95e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.113341:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fab95e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969452.113344:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 179 00000100:00100000:1.0:1783969452.113352:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+60:11491:x1870627272208000:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783969452.113374:0:10288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969452.113392:0:10288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fab965 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb633b1 expref: -99 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.113449:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fab965 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633b1 expref: 60 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.113463:0:10288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fab965 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633b1 expref: 60 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.113577:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ac78c550a00) 00010000:00010000:1.0:1783969452.113580:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783969452.113583:0:10288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bf60f200, rc 0) 00000100:00100000:1.0:1783969452.113640:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+60:11491:x1870627272208000:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 287us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969452.113648:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 179 00000100:00100000:3.0:1783969452.116389:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969452.116580:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272208128 00000100:00100000:2.0:1783969452.116589:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272208128 00000100:00080000:0.0:1783969452.116643:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969452.116651:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 50 00000100:00100000:2.0:1783969452.116661:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+6:2351:x1870627272208128:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1783969452.117342:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+7:2351:x1870627272208128:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 Request processed in 679us (958us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1783969452.117350:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 50 00000100:00100000:2.0:1783969452.120582:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969452.120684:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272208384 00000100:00100000:0.0:1783969452.120708:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272208384 00000100:00100000:0.0:1783969452.120803:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 49 00000100:00100000:0.0:1783969452.120813:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac782fb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+60:11491:x1870627272208384:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783969452.121066:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac782fb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+61:11491:x1870627272208384:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 254us (491us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1783969452.121074:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 49 00000100:00100000:0.0:1783969452.123741:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969452.129349:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272208640 00000100:00100000:2.0:1783969452.129364:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272208640 00000100:00100000:2.0:1783969452.129424:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 180 00000100:00100000:2.0:1783969452.129434:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+61:11491:x1870627272208640:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783969452.129554:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+61:11491:x1870627272208640:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 120us (5820us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969452.129562:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 180 00000100:00100000:3.0:1783969452.134113:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280590976:0@lo:400:kworker.0 00000100:00100000:3.0:1783969452.134184:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969452.134229:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1be2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280591488:0@lo:400:kworker.0 00000100:00100000:3.0:1783969452.134254:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969452.134290:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969452.134296:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1be0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280591104:0@lo:400:kworker.0 00000100:00100000:3.0:1783969452.134318:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969452.134350:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280590976 00000100:00100000:3.0:1783969452.134356:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280590976 00000100:00100000:3.0:1783969452.134392:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280591104 00000100:00100000:3.0:1783969452.134395:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280591104 00000100:00100000:3.0:1783969452.134422:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783969452.134430:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280590976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969452.134479:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280590976:12345-0@lo:400:kworker.0 Request processed in 50us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969452.134485:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783969452.134502:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783969452.134507:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280591104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969452.134651:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280591104:12345-0@lo:400:kworker.0 Request processed in 143us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969452.134724:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783969452.134744:0:9934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280591488 00000100:00100000:3.0:1783969452.134747:0:9934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280591488 00000100:00100000:3.0:1783969452.134774:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783969452.134785:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280591488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969452.134815:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280591488:12345-0@lo:400:kworker.0 Request processed in 35us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969452.134821:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1783969452.134838:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783969452.134843:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969452.134897:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1be0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280591104:0@lo:400:kworker.0 00000100:00100000:3.0:1783969452.134926:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280590976:0@lo:400:kworker.0 00000100:00100000:3.0:1783969452.134935:0:3287:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1783969452.134941:0:3287:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1783969452.134961:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1be2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280591488:0@lo:400:kworker.0 00000100:00100000:1.0:1783969452.135102:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1be2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280591232:0@lo:400:kworker.0 00000100:00100000:1.0:1783969452.135134:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969452.135177:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783969452.135184:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1be1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280590848:0@lo:400:kworker.0 00000100:00100000:1.0:1783969452.135211:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969452.135231:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1be0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1870627280591360:0@lo:400:kworker.0 00000100:00100000:1.0:1783969452.135264:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969452.135289:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280591360 00000100:00100000:1.0:1783969452.135293:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280591360 00000100:00100000:1.0:1783969452.135321:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783969452.135328:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1870627280591360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969452.135363:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1870627280591360:12345-0@lo:400:kworker.0 Request processed in 36us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969452.135370:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783969452.135395:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1be0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1870627280591360:0@lo:400:kworker.0 00000100:00100000:3.0:1783969452.136927:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280591232 00000100:00100000:3.0:1783969452.136942:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280591232 00000100:00100000:3.0:1783969452.137087:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783969452.137097:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280591232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969452.137196:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280591232:12345-0@lo:400:kworker.0 Request processed in 101us (2060us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969452.137204:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783969452.137278:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00080000:3.0:1783969452.137297:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969452.137311:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272208768 00000100:00100000:3.0:1783969452.137314:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272208768 00000100:00100000:3.0:1783969452.137343:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 181 00000100:00100000:3.0:1783969452.137349:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+61:11491:x1870627272208768:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969452.137365:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969452.137391:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab96c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb633b8 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.137462:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab973 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.137478:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab973 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.137503:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab973 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969452.137542:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783969452.137561:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab973 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.137588:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fab96c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633b8 expref: 63 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.137605:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab973 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633b8 expref: 62 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.137614:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ac78c550a00) 00010000:00010000:3.0:1783969452.137617:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783969452.137621:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7400, rc 0) 00000100:00100000:2.0:1783969452.137828:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280590848 00000100:00100000:2.0:1783969452.137842:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280590848 00000100:00100000:2.0:1783969452.137904:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1783969452.137912:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:3285:x1870627280590848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969452.137959:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:3285:x1870627280590848:12345-0@lo:400:kworker.0 Request processed in 48us (2746us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969452.137967:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1783969452.138767:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+62:11491:x1870627272208768:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 1413us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969452.138776:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 181 00000100:00100000:3.0:1783969452.139311:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1be1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280590848:0@lo:400:kworker.0 00000100:00100000:3.0:1783969452.139328:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1be2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280591232:0@lo:400:kworker.0 00000100:00100000:1.0:1783969452.145569:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969452.145841:0:9934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272208896 00000100:00100000:0.0:1783969452.145851:0:9934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272208896 00000100:00100000:0.0:1783969452.146153:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 51 00000100:00100000:0.0:1783969452.146163:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+7:2350:x1870627272208896:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783969452.146190:0:9934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969452.146209:0:9934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058d86b44/0xbacf56d076fab97a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb633bf expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783969452.146236:0:9934:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5536ac, blocks: 0x1 00010000:00010000:0.0:1783969452.146254:0:9934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=309s v=(0 0) 00010000:00010000:0.0:1783969452.146258:0:9934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969452.146269:0:9934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058d86b44/0xbacf56d076fab97a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633bf expref: 8 pid: 9934 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.146287:0:9934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000058d86b44/0xbacf56d076fab97a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633bf expref: 8 pid: 9934 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.146300:0:9934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93800, rc 0) 00000100:00100000:0.0:1783969452.146357:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+8:2350:x1870627272208896:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 195us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969452.146373:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 51 00000100:00100000:0.0:1783969452.156537:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969452.156606:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272209152 00000100:00100000:1.0:1783969452.156615:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272209152 00000100:00100000:1.0:1783969452.156754:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 182 00000100:00100000:1.0:1783969452.156764:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+62:11491:x1870627272209152:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783969452.156899:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+62:11491:x1870627272209152:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 136us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969452.156907:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 182 00000100:00100000:2.0:1783969452.164362:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969452.164429:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272209280 00000100:00100000:3.0:1783969452.164439:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272209280 00000100:00100000:3.0:1783969452.164495:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 52 00000100:00100000:3.0:1783969452.164504:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+8:11491:x1870627272209280:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969452.164522:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969452.164549:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ca8fbd8/0xbacf56d076fab981 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb633c6 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.164581:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000058d86b44/0xbacf56d076fab97a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633bf expref: 9 pid: 9934 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.164589:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969452.164594:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969452.164599:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ca8fbd8/0xbacf56d076fab981 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633c6 expref: 9 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.164632:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000058d86b44/0xbacf56d076fab97a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633bf expref: 9 pid: 9934 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.164645:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000058d86b44/0xbacf56d076fab97a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633bf expref: 9 pid: 9934 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969452.164752:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1be2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6593:1870627280591616:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783969452.164905:0:6593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfda66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969452.175468:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1be2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6593:1870627280591616:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783969452.175506:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005ca8fbd8/0xbacf56d076fab981 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633c6 expref: 9 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.175527:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de6a00, rc 0) 00000100:00100000:3.0:1783969452.175585:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+9:11491:x1870627272209280:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 11081us (11233us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969452.175608:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 52 00000100:00100000:2.0:1783969452.189668:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969452.189830:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272209408 00000100:00100000:3.0:1783969452.189841:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272209408 00010000:00010000:3.0:1783969452.189914:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000058d86b44/0xbacf56d076fab97a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633bf expref: 9 pid: 9934 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969452.189944:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 70 00000100:00100000:3.0:1783969452.189953:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03985e57-ffb4-414b-b30c-e72697857d4f+9:2350:x1870627272209408:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969452.189966:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969452.189989:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000058d86b44/0xbacf56d076fab97a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633bf expref: 9 pid: 9934 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.190004:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000058d86b44/0xbacf56d076fab97a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633bf expref: 9 pid: 9934 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.190027:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058d86b44/0xbacf56d076fab97a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633bf expref: 9 pid: 9934 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.190040:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969452.190044:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969452.190052:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005ca8fbd8/0xbacf56d076fab981 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633c6 expref: 8 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.190063:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ca8fbd8/0xbacf56d076fab981 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633c6 expref: 8 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.190116:0:5780:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005ca8fbd8/0xbacf56d076fab981 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633c6 expref: 8 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969452.190130:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1be2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5780:1870627280591744:192.168.203.39@tcp:105: 00000100:00100000:3.0:1783969452.190263:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfda66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969452.200729:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969452.200905:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272209536 00000100:00100000:2.0:1783969452.200914:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272209536 00002000:00100000:2.0:1783969452.200963:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9ac7c1be1c00 x1870627272209536/t0(0) o4->03985e57-ffb4-414b-b30c-e72697857d4f@192.168.203.39@tcp:348/0 lens 504/0 e 0 to 0 dl 1783969463 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783969452.200974:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac7c1be1c00 with x1870627272209536 ext(0->8) 00002000:00010000:2.0:1783969452.200978:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ac7c1be1c00 00000100:00100000:2.0:1783969452.201005:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:2.0:1783969452.201014:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:03985e57-ffb4-414b-b30c-e72697857d4f+9:2351:x1870627272209536:12345-192.168.203.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783969452.201467:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:03985e57-ffb4-414b-b30c-e72697857d4f+11:2351:x1870627272209536:12345-192.168.203.39@tcp:4:lhsmtool_posix.0 Request processed in 452us (748us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1783969452.201475:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4 00002000:00100000:2.0:1783969452.201481:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9ac7c1be1c00 x1870627272209536/t4294967314(0) o4->03985e57-ffb4-414b-b30c-e72697857d4f@192.168.203.39@tcp:348/0 lens 504/448 e 0 to 0 dl 1783969463 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783969452.201490:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac7c1be1c00 with x1870627272209536 ext(0->8) 00002000:00010000:2.0:1783969452.201494:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ac7c1be1c00 00000100:00100000:2.0:1783969452.201606:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1be2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5780:1870627280591744:192.168.203.39@tcp:105: 00010000:00010000:2.0:1783969452.201630:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969452.201663:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03985e57-ffb4-414b-b30c-e72697857d4f+10:2350:x1870627272209408:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 11710us (12014us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969452.201671:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 70 00000100:00100000:3.0:1783969452.212614:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969452.212821:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272209664 00000100:00100000:2.0:1783969452.212830:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272209664 00000100:00100000:2.0:1783969452.212909:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 183 00000100:00100000:2.0:1783969452.212919:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+62:11491:x1870627272209664:12345-192.168.203.39@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1783969452.264701:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+62:11491:x1870627272209664:12345-192.168.203.39@tcp:44:lhsmtool_posix.0 Request processed in 51773us (52085us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969452.264714:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 183 00000100:00100000:2.0:1783969452.266829:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000001:00080000:2.0:1783969452.266910:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:2.0:1783969452.266923:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1783969452.266980:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ac7bfa45240 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1783969452.266985:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ac7860c9300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ac7bfa45780 00000020:00080000:2.0:1783969452.266988:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ac7860c9e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ac787dcdc00 00000004:00080000:2.0:1783969452.267040:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1783969452.267184:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1783969452.267351:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1783969452.267419:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280591872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783969452.267468:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969452.267523:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280592000:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783969452.267547:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969452.267579:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272209792 00000100:00100000:2.0:1783969452.267585:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272209792 00000100:00100000:2.0:1783969452.267621:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280591872 00000100:00100000:2.0:1783969452.267639:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280591872 00000100:00100000:3.0:1783969452.267756:0:9934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280592000 00000100:00100000:3.0:1783969452.267760:0:9934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280592000 00000100:00100000:3.0:1783969452.267784:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 53 00000100:00100000:3.0:1783969452.267792:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+10:2348:x1870627272209792:12345-192.168.203.39@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1783969452.270824:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783969452.270845:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280591872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1783969452.271089:0:6595:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783969452.272098:0:6595:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783969452 00002000:00010000:2.0:1783969452.272102:0:6595:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783969452.272104:0:6595:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1783969452 -> 1783969452 00002000:00010000:2.0:1783969452.272107:0:6595:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1783969452.273070:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3288:x1870627280591872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2228us (5596us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1783969452.273082:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783969452.273112:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783969452.273124:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280592000:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783969452.273151:0:6595:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1783969452.273190:0:6595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a5536a9, atime: 0x6a5536aa, ctime: 0x6a5536a9, blocks: 0xb 00010000:00010000:2.0:1783969452.273198:0:6595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e79bd59/0xbacf56d076fab988 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.273211:0:6595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=309s v=(0 0) 00010000:00010000:2.0:1783969452.273216:0:6595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969452.273222:0:6595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e79bd59/0xbacf56d076fab988 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.273237:0:6595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e79bd59/0xbacf56d076fab988 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.273247:0:6595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e79bd59/0xbacf56d076fab988 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.273263:0:6595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e79bd59/0xbacf56d076fab988 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.273283:0:6595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783969452.273805:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3285:x1870627280592000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 684us (6254us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1783969452.273813:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00010000:2.0:1783969452.273854:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969452.273894:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e79bd59/0xbacf56d076fab988 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.273904:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786098800 already unused, calling callback (ffffffffc1485230) 00010000:00010000:2.0:1783969452.273909:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e79bd59/0xbacf56d076fab988 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.273919:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e79bd59/0xbacf56d076fab988 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.273935:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e79bd59/0xbacf56d076fab988 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.273942:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e79bd59/0xbacf56d076fab988 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.273958:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969452.273965:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969452.273967:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783969452.274113:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ac7bff35f80/2, rc 0, transno 4294967307 00000100:00100000:2.0:1783969452.274120:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280592000:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1783969452.280354:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ac7bff35500/2, rc 0, transno 4294967315 00000100:00100000:3.0:1783969452.280369:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280591872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1783969452.322443:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+10:2348:x1870627272209792:12345-192.168.203.39@tcp:16:lhsmtool_posix.0 Request processed in 54641us (55611us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969452.322456:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 53 00000100:00100000:3.0:1783969452.324668:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969452.325304:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272210048 00000100:00100000:1.0:1783969452.325313:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272210048 00000100:00100000:1.0:1783969452.325363:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 184 00000100:00100000:1.0:1783969452.325371:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+18:11491:x1870627272210048:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783969452.325416:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969452.325441:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fab973 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633b8 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.325458:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ac78c550a00) 00010000:00010000:1.0:1783969452.325474:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783969452.325502:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab98f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.325516:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab98f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.325526:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab98f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783969452.325784:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f28623ed reply state 00000000a5467b4c transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab98f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969452.325793:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783969452.325912:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+19:11491:x1870627272210048:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 540us (1262us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1783969452.325920:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 184 00000001:00080000:0.0:1783969452.326337:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:1.0:1783969452.330174:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969452.330384:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272210176 00000100:00100000:3.0:1783969452.330394:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272210176 00000100:00100000:3.0:1783969452.330464:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 56 00000100:00100000:3.0:1783969452.330475:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+7:2351:x1870627272210176:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783969452.330653:0:6593:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1783969452.330657:0:6593:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1783969452 -> 1783969451 00002000:00010000:3.0:1783969452.330673:0:6593:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783969450 00002000:00010000:3.0:1783969452.330675:0:6593:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1783969452 -> 1783969451 00002000:00010000:3.0:1783969452.330678:0:6593:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1783969452.330740:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+8:2351:x1870627272210176:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 Request processed in 268us (580us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1783969452.330749:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 56 00000100:00100000:1.0:1783969452.333102:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969452.333349:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272210432 00000100:00100000:0.0:1783969452.333359:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272210432 00000100:00100000:0.0:1783969452.333415:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 185 00000100:00100000:0.0:1783969452.333424:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+19:11491:x1870627272210432:12345-192.168.203.39@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1783969452.333491:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab996 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.333507:0:6618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab957 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633aa expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.333516:0:6618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab996 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.333551:0:6618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab957 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633aa expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.333564:0:6618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab957 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633aa expref: 19 pid: 5794 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969452.333578:0:6618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1b98a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6618:1870627280592128:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783969452.333673:0:6618:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7c18e2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969452.336174:0:6618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1b98a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6618:1870627280592128:192.168.203.39@tcp:104: 00010000:00010000:1.0:1783969452.336204:0:6618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab996 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969452.336692:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969452.337013:0:8304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272210560 00000100:00100000:0.0:1783969452.337020:0:8304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272210560 00010000:00010000:0.0:1783969452.337056:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab957 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633aa expref: 20 pid: 5794 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969452.337110:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 71 00000100:00100000:0.0:1783969452.337120:0:8304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+20:2351:x1870627272210560:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969452.337134:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969452.337141:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab957 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633aa expref: 20 pid: 5794 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.337153:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab957 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633aa expref: 20 pid: 5794 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.337187:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fab957 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633aa expref: 20 pid: 5794 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.337202:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ac78c550a00) 00010000:00010000:0.0:1783969452.337207:0:8304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab996 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.337217:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab996 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.337224:0:8304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab996 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.337253:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969452.337305:0:8304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+19:2351:x1870627272210560:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 186us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969452.337312:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 71 00010000:00010000:3.0:1783969452.337471:0:6618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab996 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.337480:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab996 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.337508:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab996 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.337515:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab996 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.337522:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab996 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.337528:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969452.337531:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab996 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.337538:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab996 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.337548:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ac78c550a00) 00010000:00010000:3.0:1783969452.337550:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1783969452.337554:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab996 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.337568:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab996 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969452.337621:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+18:11491:x1870627272210432:12345-192.168.203.39@tcp:55:lhsmtool_posix.0 Request processed in 4197us (4527us total) trans 0 rc -22/-22 00000100:00100000:3.0:1783969452.337629:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 185 00010000:00010000:2.0:1783969452.339768:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab98f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.339785:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab98f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.339792:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab98f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.339798:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60ec00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969452.339802:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab98f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.339809:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab98f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.339833:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ac78c550a00) 00010000:00010000:2.0:1783969452.339836:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969452.339840:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab98f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.339847:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ec00/0xbacf56d076fab98f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969452.342387:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969452.342462:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272210688 00000100:00100000:2.0:1783969452.342471:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272210688 00000100:00100000:2.0:1783969452.342529:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 57 00000100:00100000:2.0:1783969452.342538:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+8:2351:x1870627272210688:12345-192.168.203.39@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783969452.342599:0:6595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008e79bd59/0xbacf56d076fab99d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.342620:0:6595:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ca8fbd8/0xbacf56d076fab981 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633c6 expref: 8 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.342630:0:6595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969452.342634:0:6595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783969452.342639:0:6595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e79bd59/0xbacf56d076fab99d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.342674:0:6595:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ca8fbd8/0xbacf56d076fab981 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633c6 expref: 8 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.342689:0:6595:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ca8fbd8/0xbacf56d076fab981 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633c6 expref: 8 pid: 6593 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969452.342705:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7aea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6595:1870627280592256:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783969452.342796:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bf56e000 going to sleep for 11 seconds 00000100:00100000:0.0:1783969452.347606:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969452.347730:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272210816 00000100:00100000:3.0:1783969452.347739:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272210816 00010000:00010000:3.0:1783969452.347779:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ca8fbd8/0xbacf56d076fab981 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633c6 expref: 9 pid: 6593 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969452.347831:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 72 00000100:00100000:3.0:1783969452.347841:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1b98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+9:2351:x1870627272210816:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969452.347856:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969452.347918:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005ca8fbd8/0xbacf56d076fab981 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633c6 expref: 9 pid: 6593 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.347933:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ca8fbd8/0xbacf56d076fab981 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633c6 expref: 9 pid: 6593 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.347958:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783969452.347963:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783969452.347969:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008e79bd59/0xbacf56d076fab99d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.347978:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e79bd59/0xbacf56d076fab99d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.348009:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969452.348055:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1b98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+9:2351:x1870627272210816:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 215us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969452.348061:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 72 00010000:00010000:2.0:1783969452.348920:0:6595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ca8fbd8/0xbacf56d076fab981 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633c6 expref: 8 pid: 6593 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969452.348937:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7aea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6595:1870627280592256:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969452.348958:0:6595:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008e79bd59/0xbacf56d076fab99d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.348983:0:6595:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008e79bd59/0xbacf56d076fab99d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.348990:0:6595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e79bd59/0xbacf56d076fab99d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.349018:0:6595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008e79bd59/0xbacf56d076fab99d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.349026:0:6595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e79bd59/0xbacf56d076fab99d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.349033:0:6595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e79bd59/0xbacf56d076fab99d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.349039:0:6595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786098800 already unused, calling callback (ffffffffc1485230) 00010000:00010000:2.0:1783969452.349043:0:6595:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e79bd59/0xbacf56d076fab99d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.349051:0:6595:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e79bd59/0xbacf56d076fab99d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.349064:0:6595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e79bd59/0xbacf56d076fab99d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.349081:0:6595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e79bd59/0xbacf56d076fab99d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969452.349140:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+7:2351:x1870627272210688:12345-192.168.203.39@tcp:1:lhsmtool_posix.0 Request processed in 6602us (6761us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969452.349147:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 57 00000100:00100000:0.0:1783969452.352927:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969452.353006:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272211072 00000100:00100000:2.0:1783969452.353015:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272211072 00000100:00100000:2.0:1783969452.353065:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 186 00000100:00100000:2.0:1783969452.353075:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bfdbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+17:11491:x1870627272211072:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783969452.353153:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099000/0xbacf56d076fab9a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.353180:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099000/0xbacf56d076fab9a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.353193:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099000/0xbacf56d076fab9a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.353372:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab9ab lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.353384:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fab965 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633b1 expref: 18 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.353391:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab9ab lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.353440:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fab965 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633b1 expref: 18 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.353461:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fab965 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633b1 expref: 18 pid: 10288 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969452.353476:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7aea680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5794:1870627280592384:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783969452.353563:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bf56e000 going to sleep for 11 seconds 00000100:00100000:0.0:1783969452.358150:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969452.358279:0:8304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272211200 00000100:00100000:3.0:1783969452.358289:0:8304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272211200 00010000:00010000:3.0:1783969452.358328:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fab965 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633b1 expref: 19 pid: 10288 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969452.358370:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 73 00000100:00100000:3.0:1783969452.358381:0:8304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bfdbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+19:2351:x1870627272211200:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969452.358396:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969452.358403:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fab965 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633b1 expref: 19 pid: 10288 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.358416:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fab965 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633b1 expref: 19 pid: 10288 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.358439:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ac78c550a00) 00010000:00010000:3.0:1783969452.358444:0:8304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab9ab lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.358453:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab9ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.358461:0:8304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab9ab lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.358493:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969452.358544:0:8304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bfdbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+19:2351:x1870627272211200:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 165us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969452.358551:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 73 00010000:00010000:1.0:1783969452.359412:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fab965 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633b1 expref: 18 pid: 10288 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969452.359432:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7aea680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5794:1870627280592384:192.168.203.39@tcp:104: 00010000:00010000:1.0:1783969452.359468:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab9ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.359478:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab9ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.359483:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab9ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783969452.360813:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1783969452.361045:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1783969452.361090:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1783969452.361453:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7b57d2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5794:1870627280592512:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783969452.361517:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969452.361554:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa45c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783969452.362122:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280592512 00000100:00100000:3.0:1783969452.362131:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280592512 00000100:00100000:3.0:1783969452.362286:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783969452.362306:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5794:x1870627280592512:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783969452.362409:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5794:x1870627280592512:12345-0@lo:1000:mdt00_001.0 Request processed in 114us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969452.362417:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783969452.362491:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7b57d2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5794:1870627280592512:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1783969452.363315:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1783969452.363389:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bfdbea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5794:1870627280592640:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783969452.363444:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969452.364473:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7c18e2600 going to sleep for 11 seconds 00000100:00100000:2.0:1783969452.364535:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280592640 00000100:00100000:2.0:1783969452.364542:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280592640 00000100:00100000:2.0:1783969452.364581:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783969452.364589:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5794:x1870627280592640:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783969452.365478:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5794:x1870627280592640:12345-0@lo:1000:mdt00_001.0 Request processed in 884us (2029us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1783969452.365487:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783969452.366157:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bfdbea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5794:1870627280592640:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1783969452.366275:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab9ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.366285:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab9ab lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.366415:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab9ab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.366423:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786098000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969452.366428:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab9ab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.366435:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab9ab lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.366450:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ac78c550a00) 00010000:00010000:0.0:1783969452.366453:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783969452.366458:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab9ab lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.366464:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fab9ab lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.366506:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab8e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.366517:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab8e0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.366523:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab8e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.366528:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60e000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969452.366531:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab8e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.366536:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab8e0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.366545:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac7829e0000) 00010000:00010000:0.0:1783969452.366548:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783969452.366551:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab8e0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.366557:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e000/0xbacf56d076fab8e0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.366578:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab9b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.366592:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fab8fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63395 expref: 21 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.366669:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab9b2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.366773:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fab8fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63395 expref: 21 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.366789:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fab8fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63395 expref: 21 pid: 5794 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969452.366804:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff3b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5794:1870627280592768:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783969452.367036:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7c18e2600 going to sleep for 11 seconds 00000100:00100000:0.0:1783969452.370353:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969452.370521:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272211328 00000100:00100000:2.0:1783969452.370530:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272211328 00010000:00010000:2.0:1783969452.370569:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fab8fc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63395 expref: 22 pid: 5794 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969452.370613:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 74 00000100:00100000:2.0:1783969452.370623:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+22:2351:x1870627272211328:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969452.370637:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969452.370644:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fab8fc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63395 expref: 22 pid: 5794 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.370676:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fab8fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63395 expref: 22 pid: 5794 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.370697:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac7829e0000) 00010000:00010000:2.0:1783969452.370703:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab9b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.370723:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab9b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.370731:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab9b2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.370750:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969452.370796:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+22:2351:x1870627272211328:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 175us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969452.370803:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 74 00010000:00010000:3.0:1783969452.372293:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fab8fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63395 expref: 21 pid: 5794 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969452.372316:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff3b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5794:1870627280592768:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783969452.372341:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab9b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.372443:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab9b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.372451:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab9b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.372464:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab9b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.372470:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab9b2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.372476:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab9b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.372482:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969452.372486:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab9b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.372493:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab9b2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.372515:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac7829e0000) 00010000:00010000:0.0:1783969452.372517:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969452.372522:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab9b2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.372528:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab9b2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.372538:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099000/0xbacf56d076fab9a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.372545:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099000/0xbacf56d076fab9a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.372550:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099000/0xbacf56d076fab9a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.372554:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786099000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969452.372557:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099000/0xbacf56d076fab9a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.372562:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099000/0xbacf56d076fab9a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.372569:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac7829e0000) 00010000:00010000:0.0:1783969452.372571:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783969452.372574:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099000/0xbacf56d076fab9a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.372579:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099000/0xbacf56d076fab9a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969452.373257:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bfdbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+20:11491:x1870627272211072:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 20180us (20336us total) trans 4294967467 rc 0/0 00000100:00100000:0.0:1783969452.373268:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 186 00000020:00080000:0.0:1783969452.373273:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783969452.373408:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783969452.373413:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783969452.374028:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1783969452.374037:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783969452.381555:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969452.381590:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272211584 00000100:00100000:0.0:1783969452.381600:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272211584 00000100:00100000:0.0:1783969452.381662:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 50 00000100:00100000:0.0:1783969452.381672:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7861e8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+20:11491:x1870627272211584:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1783969452.382546:0:5796:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1783969452.383023:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:0.0:1783969452.383073:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab9b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.383089:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab9b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.383100:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab9b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.383108:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab9b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.383115:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab9b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.383122:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab9b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.384364:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783969452.384471:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7861e8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+22:11491:x1870627272211584:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 2796us (2919us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1783969452.384482:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 50 00000020:00080000:0.0:1783969452.384488:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783969452.393580:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969452.393592:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab9b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.393602:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93000 already unused, calling callback (ffffffffc1485230) 00010000:00010000:2.0:1783969452.393606:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab9b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.393615:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab9b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.393632:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ac790086b00) 00010000:00010000:2.0:1783969452.393642:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783969452.393663:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab9b9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.393669:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fab9b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.393702:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969452.393704:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969452.393706:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783969452.517519:0:12304:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783969452.517527:0:12304:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783969452.517559:0:12304:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1783969452.517564:0:12304:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1783969452.582325:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969452.646514:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7b57d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280592896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783969452.646582:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969452.646661:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280592896 00000100:00100000:2.0:1783969452.646668:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280592896 00000100:00100000:2.0:1783969452.646719:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783969452.646731:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7aea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1870627280592896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783969452.646764:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783969452.646805:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7aea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1870627280592896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969452.646812:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783969452.646893:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7b57d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280592896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783969452.662787:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969452.662853:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272211840 00000100:00100000:3.0:1783969452.662911:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272211840 00000100:00100000:3.0:1783969452.662968:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 187 00000100:00100000:3.0:1783969452.662978:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+22:11502:x1870627272211840:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783969452.663009:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969452.663029:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab9c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb633cd expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.663297:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7e00/0xbacf56d076fab9c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.663312:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7e00/0xbacf56d076fab9c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.663323:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7e00/0xbacf56d076fab9c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969452.663334:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1783969452.663489:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab9c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633cd expref: 25 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.663505:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7e00/0xbacf56d076fab9c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633cd expref: 24 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.663514:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:3.0:1783969452.663516:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783969452.663519:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7e00, rc 0) 00000100:00100000:3.0:1783969452.663571:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+24:11502:x1870627272211840:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 594us (791us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1783969452.663577:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 187 00000100:00100000:0.0:1783969452.677518:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969452.677585:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272211968 00000100:00100000:3.0:1783969452.677595:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272211968 00000100:00100000:3.0:1783969452.677649:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 188 00000100:00100000:3.0:1783969452.677672:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+24:11502:x1870627272211968:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:3.0:1783969452.677746:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab9d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.677762:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab9d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.677773:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab9d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.677788:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab9dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.677796:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab9dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.677804:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab9dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.678126:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab9e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.678136:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.678144:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783969452.678424:0:6618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.678438:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab9d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.678450:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab9d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.678457:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab9d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.678463:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de7800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969452.678467:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab9d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.678474:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab9d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.678487:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:3.0:1783969452.678490:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969452.678494:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab9d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.678500:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fab9d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.678511:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab9dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.678517:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab9dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.678522:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab9dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.678527:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969452.678535:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab9dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.678541:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab9dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.678548:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ac78c550f00) 00010000:00010000:3.0:1783969452.678551:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969452.678553:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab9dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.678558:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fab9dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.678572:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab9e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.678577:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab9e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.678583:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab9e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.678588:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969452.678590:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab9e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.678595:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab9e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.678602:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac78c550800) 00010000:00010000:3.0:1783969452.678604:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969452.678611:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab9e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.678618:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fab9e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969452.678726:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+24:11502:x1870627272211968:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 1054us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969452.678735:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 188 00000100:00100000:0.0:1783969452.721054:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969452.721089:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272212224 00000100:00100000:0.0:1783969452.721097:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272212224 00000100:00100000:0.0:1783969452.721147:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 189 00000100:00100000:0.0:1783969452.721156:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+24:11505:x1870627272212224:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783969452.721187:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969452.721314:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab9ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb633d4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.721388:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab9f1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.721402:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab9f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.721412:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab9f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.721438:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab9f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.721445:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab9f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.721451:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab9f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.721750:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab9ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.721759:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab9ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.721766:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab9ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969452.721776:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1783969452.721895:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab9f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.721903:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab9f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.721910:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab9f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.721916:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969452.721920:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab9f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.721939:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab9f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.721951:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:0.0:1783969452.721954:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969452.721958:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab9f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.721963:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fab9f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.721972:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab9f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.721978:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab9f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.721984:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab9f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.721989:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969452.721992:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab9f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.721998:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab9f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.722005:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ac790086900) 00010000:00010000:0.0:1783969452.722008:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969452.722010:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab9f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.722026:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fab9f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.722068:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fab9ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633d4 expref: 27 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.722081:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab9ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633d4 expref: 26 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.722089:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac790086300) 00010000:00010000:0.0:1783969452.722091:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969452.722093:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92e00, rc 0) 00000100:00100000:0.0:1783969452.722149:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+26:11505:x1870627272212224:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 993us (1103us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1783969452.722157:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 189 00000100:00100000:3.0:1783969452.735562:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969452.735628:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272212352 00000100:00100000:2.0:1783969452.735639:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272212352 00000100:00100000:2.0:1783969452.735692:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 190 00000100:00100000:2.0:1783969452.735702:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+26:11505:x1870627272212352:12345-192.168.203.39@tcp:54:lfs.0 00010000:00010000:2.0:1783969452.735767:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099e00/0xbacf56d076faba0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.735796:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099e00/0xbacf56d076faba0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.735809:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099e00/0xbacf56d076faba0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.735836:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099e00/0xbacf56d076faba0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.735843:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099e00/0xbacf56d076faba0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.735849:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099e00/0xbacf56d076faba0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.735923:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786099e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969452.735929:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099e00/0xbacf56d076faba0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.735937:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099e00/0xbacf56d076faba0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.735949:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac790086300) 00010000:00010000:2.0:1783969452.735952:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783969452.735956:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099e00/0xbacf56d076faba0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.735963:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099e00/0xbacf56d076faba0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969452.736023:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+26:11505:x1870627272212352:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 321us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969452.736037:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 190 00000100:00100000:0.0:1783969452.742676:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969452.746058:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272212608 00000100:00100000:1.0:1783969452.746072:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272212608 00000100:00100000:1.0:1783969452.746139:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 51 00000100:00100000:1.0:1783969452.746149:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+26:11505:x1870627272212608:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1783969452.746386:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+27:11505:x1870627272212608:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 236us (3718us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1783969452.746407:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 51 00000100:00100000:0.0:1783969452.782806:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969452.782982:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272212864 00000100:00100000:3.0:1783969452.782992:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272212864 00000100:00100000:3.0:1783969452.783047:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 191 00000100:00100000:3.0:1783969452.783055:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+27:11039:x1870627272212864:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:3.0:1783969452.783077:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969452.783096:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faba14 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb633db expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.783189:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faba1b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.783203:0:6618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab9ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633d4 expref: 28 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.783212:0:6618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faba1b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.783244:0:6618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab9ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633d4 expref: 28 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.783274:0:6618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab9ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633d4 expref: 28 pid: 5794 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969452.783287:0:6618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1be2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6618:1870627280593024:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783969452.783378:0:6618:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b2faf900 going to sleep for 11 seconds 00000100:00100000:3.0:1783969452.787372:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969452.788144:0:8304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272212992 00000100:00100000:0.0:1783969452.788153:0:8304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272212992 00010000:00010000:0.0:1783969452.788202:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab9ff lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633d4 expref: 29 pid: 5794 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969452.788247:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 75 00000100:00100000:0.0:1783969452.788257:0:8304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+29:2351:x1870627272212992:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969452.788284:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969452.788292:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab9ff lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633d4 expref: 29 pid: 5794 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.788320:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab9ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633d4 expref: 29 pid: 5794 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.788343:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac790086300) 00010000:00010000:0.0:1783969452.788349:0:8304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faba1b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.788358:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faba1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.788365:0:8304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faba1b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.788383:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969452.788442:0:8304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+29:2351:x1870627272212992:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 186us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969452.788450:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 75 00010000:00010000:1.0:1783969452.790507:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fab9ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633d4 expref: 28 pid: 5794 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969452.790831:0:6618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1be2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6618:1870627280593024:192.168.203.39@tcp:104: 00010000:00010000:1.0:1783969452.790943:0:6618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faba1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.790974:0:6618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faba1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.790979:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faba1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969452.790998:0:6618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1783969452.791144:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faba14 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633db expref: 29 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.791168:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faba1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633db expref: 28 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.791178:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac790086300) 00010000:00010000:1.0:1783969452.791181:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783969452.791183:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de6800, rc 0) 00000100:00100000:1.0:1783969452.791242:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+28:11039:x1870627272212864:12345-192.168.203.39@tcp:101:bash.0 Request processed in 8186us (8444us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1783969452.791251:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 191 00000100:00100000:2.0:1783969452.797660:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969452.797759:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272213248 00000100:00100000:0.0:1783969452.797768:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272213248 00000100:00100000:0.0:1783969452.797893:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 192 00000100:00100000:0.0:1783969452.797904:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+28:11039:x1870627272213248:12345-192.168.203.39@tcp:36:bash.0 00010000:00010000:0.0:1783969452.799695:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faba29 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.799718:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faba29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.799730:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faba29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783969452.799793:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:0.0:1783969452.799818:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f667f979 reply state 00000000f99dccf6 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faba29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969452.799828:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1783969452.799906:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:0.0:1783969452.800013:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+32:11039:x1870627272213248:12345-192.168.203.39@tcp:36:bash.0 Request processed in 2108us (2359us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1783969452.800022:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 192 00000020:00080000:0.0:1783969452.800028:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1783969452.804721:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faba29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.804739:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faba29 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.804746:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faba29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.804752:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969452.804770:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faba29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.804777:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faba29 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.804794:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac790086300) 00010000:00010000:1.0:1783969452.804797:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969452.804801:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faba29 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.804807:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faba29 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969452.811278:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969452.812687:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272213376 00000100:00100000:3.0:1783969452.812699:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272213376 00000100:00100000:3.0:1783969452.812766:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 193 00000100:00100000:3.0:1783969452.812775:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+31:11039:x1870627272213376:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:3.0:1783969452.812797:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969452.812816:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076faba30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb633e2 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.812921:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076faba30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633e2 expref: 32 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.812937:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076faba30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633e2 expref: 32 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.812958:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac790086300) 00010000:00010000:3.0:1783969452.812962:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783969452.812966:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7800, rc 0) 00000100:00100000:3.0:1783969452.813029:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+32:11039:x1870627272213376:12345-192.168.203.39@tcp:101:bash.0 Request processed in 255us (1759us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969452.813053:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 193 00000100:00100000:1.0:1783969452.816957:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969452.817080:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272213504 00000100:00100000:3.0:1783969452.817089:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272213504 00000100:00100000:3.0:1783969452.817143:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 58 00000100:00100000:3.0:1783969452.817153:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+7:11039:x1870627272213504:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:3.0:1783969452.817169:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969452.817187:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e40bea74/0xbacf56d076faba37 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb633e9 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783969452.817213:0:6593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a5536ab, atime: 0x6a5536aa, ctime: 0x6a5536ab, blocks: 0xb 00010000:00010000:3.0:1783969452.817234:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=309s v=(0 0) 00010000:00010000:3.0:1783969452.817239:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969452.817247:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e40bea74/0xbacf56d076faba37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633e9 expref: 8 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.817263:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e40bea74/0xbacf56d076faba37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633e9 expref: 8 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.817275:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7a00, rc 0) 00000100:00100000:3.0:1783969452.817333:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+8:11039:x1870627272213504:12345-192.168.203.39@tcp:101:bash.0 Request processed in 180us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969452.817340:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 58 00000100:00100000:0.0:1783969452.829340:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969452.829434:0:6600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272213632 00000100:00100000:1.0:1783969452.829442:0:6600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272213632 00002000:00010000:1.0:1783969452.829482:0:6600:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1783969452.829487:0:6600:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac7bff39500 with x1870627272213632 ext(0->18446744073709551615) 00002000:00010000:1.0:1783969452.829498:0:6600:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ac7bff39500. 00000100:00100000:1.0:1783969452.829539:0:6600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:1.0:1783969452.829548:0:6600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:03985e57-ffb4-414b-b30c-e72697857d4f+8:2350:x1870627272213632:12345-192.168.203.39@tcp:10:bash.0 00002000:00010000:1.0:1783969452.829811:0:6600:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1783969452.829815:0:6600:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1783969451 -> 1783969452 00002000:00010000:1.0:1783969452.829817:0:6600:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1783969450 -> 1783969450 00002000:00010000:1.0:1783969452.829820:0:6600:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1783969451 -> 1783969452 00002000:00010000:1.0:1783969452.829822:0:6600:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1783969452.829922:0:6600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:03985e57-ffb4-414b-b30c-e72697857d4f+9:2350:x1870627272213632:12345-192.168.203.39@tcp:10:bash.0 Request processed in 374us (590us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1783969452.829944:0:6600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5 00002000:00010000:1.0:1783969452.829948:0:6600:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1783969452.829950:0:6600:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac7bff39500 with x1870627272213632 ext(0->18446744073709551615) 00002000:00010000:1.0:1783969452.829955:0:6600:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ac7bff39500. 00000100:00100000:2.0:1783969452.905989:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969452.906084:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272213760 00000100:00100000:1.0:1783969452.906095:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272213760 00000100:00100000:1.0:1783969452.906152:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 194 00000100:00100000:1.0:1783969452.906162:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+32:11519:x1870627272213760:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:1.0:1783969452.906241:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076faba3e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.906257:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076faba3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.906268:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076faba3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.906282:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076faba45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.906290:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076faba45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.906296:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076faba45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.906570:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076faba4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.906580:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076faba4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.906595:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076faba4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783969452.906633:0:6618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076faba4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.906642:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076faba3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.906648:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076faba3e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.906655:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076faba3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.906661:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60f600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969452.906665:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076faba3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.906673:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076faba3e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.906685:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:1.0:1783969452.906688:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969452.906692:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076faba3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.906699:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f600/0xbacf56d076faba3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.906915:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076faba45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.906929:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076faba45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.906935:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076faba45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.906939:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60f400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969452.906943:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076faba45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.906949:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076faba45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.906958:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ac7829e0d00) 00010000:00010000:1.0:1783969452.906960:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969452.906963:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076faba45 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.906969:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076faba45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.906984:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076faba4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.906990:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076faba4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.906996:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076faba4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.907000:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60fe00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969452.907010:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076faba4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.907015:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076faba4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.907023:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac790086300) 00010000:00010000:1.0:1783969452.907025:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969452.907027:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076faba4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969452.907032:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60fe00/0xbacf56d076faba4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969452.907103:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+32:11519:x1870627272213760:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 941us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969452.907113:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 194 00000100:00100000:3.0:1783969452.954015:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969452.954325:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272214016 00000100:00100000:0.0:1783969452.954336:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272214016 00000100:00100000:0.0:1783969452.954404:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 195 00000100:00100000:0.0:1783969452.954414:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+32:11522:x1870627272214016:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783969452.954433:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969452.954454:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076faba53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb633f0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.954540:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faba5a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.954554:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faba5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.954567:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faba5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.954582:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076faba61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.954602:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076faba61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.954609:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076faba61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.956065:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076faba68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.956081:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076faba68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.956090:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076faba68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969452.956102:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1783969452.957118:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faba5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.957130:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faba5a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.957137:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faba5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.957143:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969452.957147:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faba5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.957154:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faba5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.957254:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:0.0:1783969452.957257:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969452.957262:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faba5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.957269:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076faba5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.957283:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076faba61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.957290:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076faba61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.957296:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076faba61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.957302:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969452.957305:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076faba61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.957311:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076faba61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.957319:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ac790086900) 00010000:00010000:0.0:1783969452.957321:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969452.957323:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076faba61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.957329:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076faba61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.957388:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076faba53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633f0 expref: 35 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.957403:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076faba68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633f0 expref: 34 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.957411:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac790086300) 00010000:00010000:0.0:1783969452.957413:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783969452.957416:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92e00, rc 0) 00000100:00100000:0.0:1783969452.957544:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+34:11522:x1870627272214016:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 3130us (3537us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1783969452.957553:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 195 00000100:00100000:0.0:1783969452.962912:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969452.963001:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272214144 00000100:00100000:3.0:1783969452.963010:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272214144 00000100:00100000:3.0:1783969452.963332:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 196 00000100:00100000:3.0:1783969452.963342:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+34:11522:x1870627272214144:12345-192.168.203.39@tcp:54:lfs.0 00010000:00010000:3.0:1783969452.963408:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faba76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.963425:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faba1b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633db expref: 34 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.963436:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faba76 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.963472:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faba1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633db expref: 34 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969452.963486:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faba1b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633db expref: 34 pid: 6618 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969452.963500:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1be2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1870627280593152:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783969452.964428:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b2faf600 going to sleep for 11 seconds 00000100:00100000:2.0:1783969452.968313:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969452.968389:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272214400 00000100:00100000:1.0:1783969452.968398:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272214400 00000100:00100000:1.0:1783969452.968504:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 52 00000100:00100000:1.0:1783969452.968531:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+35:5578:x1870627272214400:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783969452.969306:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1be2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1870627280593152:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783969452.969332:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faba76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969452.969461:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+36:5578:x1870627272214400:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 946us (1155us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1783969452.969470:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 52 00000100:00100000:3.0:1783969452.973224:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969452.973304:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272214528 00000100:00100000:2.0:1783969452.973315:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272214528 00010000:00010000:2.0:1783969452.973357:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faba1b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633db expref: 36 pid: 6618 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969452.973398:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 76 00000100:00100000:2.0:1783969452.973408:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786a62c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+36:2350:x1870627272214528:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969452.973421:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969452.973428:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faba1b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633db expref: 36 pid: 6618 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.973442:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faba1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633db expref: 36 pid: 6618 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.973461:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076faba1b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633db expref: 36 pid: 6618 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.973477:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac790086300) 00010000:00010000:2.0:1783969452.973483:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faba76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.973492:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faba76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.973513:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faba76 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969452.973556:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783969452.974457:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faba76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.974469:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faba76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.974499:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faba76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.974506:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faba76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.974513:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faba76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.974527:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969452.974544:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faba76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.974551:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faba76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.974562:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac790086300) 00010000:00010000:0.0:1783969452.974565:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783969452.974569:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faba76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969452.974575:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faba76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969452.974755:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786a62c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+35:2350:x1870627272214528:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 1345us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969452.974764:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 76 00000100:00100000:0.0:1783969452.976139:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+34:11522:x1870627272214144:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 12790us (13227us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969452.976149:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 196 00000100:00100000:1.0:1783969452.978183:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969452.978255:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272214784 00000100:00100000:0.0:1783969452.978264:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272214784 00000100:00100000:0.0:1783969452.978311:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 53 00000100:00100000:0.0:1783969452.978320:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+34:11522:x1870627272214784:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1783969452.978599:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+35:11522:x1870627272214784:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 278us (423us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1783969452.978608:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 53 00000100:00100000:1.0:1783969453.068954:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969453.069196:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272215040 00000100:00100000:3.0:1783969453.069206:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272215040 00000100:00100000:3.0:1783969453.069290:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 197 00000100:00100000:3.0:1783969453.069301:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+35:11533:x1870627272215040:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:3.0:1783969453.069340:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969453.069359:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076faba7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb633f7 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.069428:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076faba84 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.069443:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076faba84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.069455:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076faba84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.069468:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076faba8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.069474:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076faba8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.069481:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076faba8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.069793:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faba92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.069803:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faba92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.069811:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faba92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969453.069821:0:6618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1783969453.069953:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076faba84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.069961:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076faba84 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.069967:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076faba84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.069974:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de7600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969453.069978:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076faba84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.069985:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076faba84 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.069996:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:3.0:1783969453.069999:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969453.070014:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076faba84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.070021:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076faba84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.070032:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076faba8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.070039:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076faba8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.070044:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076faba8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.070049:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de7400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969453.070059:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076faba8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.070065:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076faba8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.070072:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ac78c550200) 00010000:00010000:3.0:1783969453.070075:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969453.070077:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076faba8b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.070082:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076faba8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.070121:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076faba7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633f7 expref: 38 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.070135:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faba92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633f7 expref: 37 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.070143:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac790086300) 00010000:00010000:3.0:1783969453.070145:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783969453.070147:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de6000, rc 0) 00000100:00100000:3.0:1783969453.070206:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+37:11533:x1870627272215040:12345-192.168.203.39@tcp:101:cat.0 Request processed in 907us (1269us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1783969453.070214:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 197 00000100:00080000:1.0:1783969453.070380:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969453.076186:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969453.076313:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272215296 00000100:00100000:0.0:1783969453.076322:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272215296 00000100:00100000:0.0:1783969453.076380:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 54 00000100:00100000:0.0:1783969453.076390:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+37:11533:x1870627272215296:12345-192.168.203.39@tcp:35:cat.0 00000100:00100000:0.0:1783969453.076619:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+38:11533:x1870627272215296:12345-192.168.203.39@tcp:35:cat.0 Request processed in 230us (442us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1783969453.076640:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 54 00000100:00100000:3.0:1783969453.111561:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969453.111664:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272215552 00000100:00100000:0.0:1783969453.111674:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272215552 00000100:00100000:0.0:1783969453.111723:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 198 00000100:00100000:0.0:1783969453.111732:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+38:11534:x1870627272215552:12345-192.168.203.39@tcp:36:rm.0 00010000:00010000:0.0:1783969453.111784:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783969453.111809:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076faba92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633f7 expref: 38 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.111829:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076faba68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633f0 expref: 37 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.111841:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076faba30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633e2 expref: 36 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.111850:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac790086300) 00010000:00010000:0.0:1783969453.111914:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783969453.111934:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabaa0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.111946:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabaa0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.111955:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabaa0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.111968:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fabaa7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.112004:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fabaa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.112012:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fabaa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.112507:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabaae lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.112516:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabaae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.112523:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabaae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783969453.113553:0:5793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1783969453.113564:0:5793:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 310195703871ns, next at 311195701544ns, rc = 0 00010000:00010000:0.0:1783969453.113624:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabab5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.113637:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabab5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.113657:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabab5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.113665:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabab5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.113670:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabab5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.113688:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabab5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.113710:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783969453.113729:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabaae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.113736:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabaae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.113742:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabaae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.113748:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969453.113752:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabaae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.113758:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabaae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.113768:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac790086600) 00010000:00010000:0.0:1783969453.113771:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783969453.113774:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabaae lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.113780:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabaae lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.113795:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabaa0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.113801:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabaa0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.113811:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabaa0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.113816:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969453.113819:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabaa0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.113825:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabaa0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.113832:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:0.0:1783969453.113834:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969453.113837:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabaa0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.113842:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabaa0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783969453.113851:0:5793:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eca1b7b4 reply state 000000002ed2eaf0 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fabaa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969453.113896:0:5793:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783969453.114445:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969453.114454:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabab5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969453.114462:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93c00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:2.0:1783969453.114466:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabab5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969453.114472:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabab5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969453.114484:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ac790086600) 00010000:00010000:2.0:1783969453.114486:0:5781:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783969453.114489:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabab5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969453.114495:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabab5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969453.114512:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969453.114524:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969453.114527:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969453.116609:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+37:11534:x1870627272215552:12345-192.168.203.39@tcp:36:rm.0 Request processed in 4866us (5044us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1783969453.116622:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 198 00010000:00010000:1.0:1783969453.117510:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fabaa7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969453.117538:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fabaa7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969453.117547:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fabaa7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969453.117553:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969453.117557:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fabaa7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969453.117564:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fabaa7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969453.117579:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ac790086900) 00010000:00010000:1.0:1783969453.117582:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969453.117586:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fabaa7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969453.117593:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fabaa7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969453.173770:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969453.173919:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272215808 00000100:00100000:0.0:1783969453.173929:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272215808 00000100:00100000:0.0:1783969453.173995:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 199 00000100:00100000:0.0:1783969453.174005:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+36:11540:x1870627272215808:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:0.0:1783969453.174043:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969453.174063:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fababc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb633fe expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.174184:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabac3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.174199:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabac3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.174211:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabac3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.174224:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fabaca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.174230:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fabaca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.174236:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fabaca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783969453.174729:0:5795:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1783969453.176128:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabad1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.176144:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.176154:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabad1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.176208:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabac3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.176215:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabac3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.176221:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabac3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.176227:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969453.176231:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabac3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.176238:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabac3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.176250:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:0.0:1783969453.176253:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969453.176256:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabac3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.176262:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabac3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783969453.176274:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009bdbd933 reply state 00000000d26b4fd8 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fabaca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969453.176282:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783969453.176314:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fababc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633fe expref: 39 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.176351:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabad1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633fe expref: 38 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.176359:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac790086a00) 00010000:00010000:0.0:1783969453.176362:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969453.176364:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92400, rc 0) 00000100:00100000:0.0:1783969453.176438:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+39:11540:x1870627272215808:12345-192.168.203.39@tcp:101:bash.0 Request processed in 2434us (2677us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1783969453.176447:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 199 00010000:00010000:2.0:1783969453.179560:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fabaca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969453.179579:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fabaca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969453.179588:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fabaca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969453.179595:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969453.179600:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fabaca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969453.179608:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fabaca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969453.179625:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ac790086300) 00010000:00010000:2.0:1783969453.179628:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969453.179633:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fabaca lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969453.179639:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fabaca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969453.183761:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969453.184128:0:9934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272215936 00000100:00100000:0.0:1783969453.184137:0:9934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272215936 00000100:00100000:0.0:1783969453.185304:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 59 00000100:00100000:0.0:1783969453.185317:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+5:2350:x1870627272215936:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:0.0:1783969453.185335:0:9934:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969453.185366:0:9934:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a983476f/0xbacf56d076fabadf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63405 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783969453.185393:0:9934:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969453.185411:0:9934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=310s v=(0 0) 00010000:00010000:0.0:1783969453.185415:0:9934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969453.185425:0:9934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a983476f/0xbacf56d076fabadf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63405 expref: 6 pid: 9934 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.185443:0:9934:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a983476f/0xbacf56d076fabadf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63405 expref: 6 pid: 9934 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.185477:0:9934:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92600, rc 0) 00000100:00100000:0.0:1783969453.185543:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+6:2350:x1870627272215936:12345-192.168.203.39@tcp:101:bash.0 Request processed in 229us (1791us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969453.185551:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 59 00000100:00080000:1.0:1783969453.185995:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783969453.189117:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969453.190093:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272216064 00000100:00100000:0.0:1783969453.190107:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272216064 00000100:00100000:0.0:1783969453.190176:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 60 00000100:00100000:0.0:1783969453.190186:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+6:11540:x1870627272216064:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:0.0:1783969453.190205:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969453.190222:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fabae6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6340c expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.190257:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a983476f/0xbacf56d076fabadf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63405 expref: 7 pid: 9934 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.190266:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969453.190271:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969453.190276:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fabae6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6340c expref: 7 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.190312:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a983476f/0xbacf56d076fabadf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63405 expref: 7 pid: 9934 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.190326:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a983476f/0xbacf56d076fabadf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63405 expref: 7 pid: 9934 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969453.190352:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6593:1870627280593280:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783969453.190446:0:6593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7c18e2480 going to sleep for 11 seconds 00000100:00100000:3.0:1783969453.197508:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969453.197832:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6593:1870627280593280:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783969453.197920:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fabae6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6340c expref: 7 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.197941:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93800, rc 0) 00000100:00100000:0.0:1783969453.198004:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+7:11540:x1870627272216064:12345-192.168.203.39@tcp:101:bash.0 Request processed in 7819us (8896us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969453.198013:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 60 00000100:00100000:1.0:1783969453.198270:0:8304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272216192 00000100:00100000:1.0:1783969453.198277:0:8304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272216192 00010000:00010000:1.0:1783969453.198311:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a983476f/0xbacf56d076fabadf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63405 expref: 7 pid: 9934 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969453.198354:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 77 00000100:00100000:1.0:1783969453.198363:0:8304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+7:2351:x1870627272216192:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969453.198387:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969453.198412:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a983476f/0xbacf56d076fabadf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63405 expref: 7 pid: 9934 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969453.198424:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a983476f/0xbacf56d076fabadf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63405 expref: 7 pid: 9934 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969453.198445:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a983476f/0xbacf56d076fabadf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63405 expref: 7 pid: 9934 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969453.198459:0:8304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969453.198463:0:8304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969453.198470:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fabae6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6340c expref: 6 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969453.198480:0:8304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fabae6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6340c expref: 6 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969453.198512:0:8304:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fabae6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6340c expref: 6 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969453.198526:0:8304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7b57d2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8304:1870627280593408:192.168.203.39@tcp:105: 00000100:00100000:1.0:1783969453.198576:0:8304:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa45d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783969453.211058:0:8304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7b57d2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8304:1870627280593408:192.168.203.39@tcp:105: 00010000:00010000:1.0:1783969453.211089:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969453.211209:0:8304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+6:2351:x1870627272216192:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 12845us (13707us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969453.211221:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 77 00000100:00100000:2.0:1783969453.221089:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969453.227546:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272216448 00000100:00100000:0.0:1783969453.227560:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272216448 00000100:00100000:0.0:1783969453.227628:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 55 00000100:00100000:0.0:1783969453.227638:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+38:11540:x1870627272216448:12345-192.168.203.39@tcp:35:bash.0 00000100:00100000:0.0:1783969453.228000:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+39:11540:x1870627272216448:12345-192.168.203.39@tcp:35:bash.0 Request processed in 362us (6921us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1783969453.228009:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 55 00000100:00100000:2.0:1783969453.442440:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969453.442556:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272216576 00000100:00100000:0.0:1783969453.442566:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272216576 00000100:00100000:0.0:1783969453.442622:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 200 00000100:00100000:0.0:1783969453.442631:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+39:11556:x1870627272216576:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783969453.442664:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969453.442683:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fabaed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63413 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.442761:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabaf4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.442786:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabaf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.442797:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabaf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969453.442889:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1783969453.442893:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783969453.442919:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabaf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.442944:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fabaed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63413 expref: 41 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.442961:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabaf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63413 expref: 40 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.442969:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:0.0:1783969453.442971:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783969453.442974:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92600, rc 0) 00000100:00100000:0.0:1783969453.443028:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+40:11556:x1870627272216576:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 397us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969453.443036:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 200 00000100:00100000:0.0:1783969453.449534:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969453.449614:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272216832 00000100:00100000:3.0:1783969453.449624:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272216832 00000100:00100000:3.0:1783969453.449685:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 201 00000100:00100000:3.0:1783969453.449695:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+40:11556:x1870627272216832:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783969453.449715:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969453.449736:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fabafb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6341a expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.449907:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fabb02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.449923:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fabb02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.449934:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fabb02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969453.449945:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1783969453.450062:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fabafb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6341a expref: 43 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.450080:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fabb02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6341a expref: 42 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.450089:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac790086a00) 00010000:00010000:3.0:1783969453.450092:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783969453.450095:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7400, rc 0) 00000100:00100000:3.0:1783969453.450140:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+42:11556:x1870627272216832:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 447us (617us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1783969453.450154:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 201 00000100:00100000:3.0:1783969453.461225:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969453.461261:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969453.461428:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272217088 00000100:00100000:0.0:1783969453.461451:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272217088 00000100:00100000:0.0:1783969453.461509:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 202 00000100:00100000:0.0:1783969453.461520:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+42:11556:x1870627272217088:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783969453.461544:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969453.461565:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fabb10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63421 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969453.461622:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272217216 00000100:00100000:2.0:1783969453.461629:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272217216 00000100:00100000:2.0:1783969453.461671:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 14 00010000:00010000:0.0:1783969453.461672:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fabb17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969453.461683:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03985e57-ffb4-414b-b30c-e72697857d4f+44:2350:x1870627272217216:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969453.461689:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fabb17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969453.461695:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969453.461703:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fabb17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969453.461715:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1783969453.461723:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fabb02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6341a expref: 44 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969453.461740:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac790086a00) 00010000:00010000:2.0:1783969453.461745:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969453.461815:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03985e57-ffb4-414b-b30c-e72697857d4f+44:2350:x1870627272217216:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 134us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969453.461823:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 14 00010000:00010000:0.0:1783969453.461836:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fabb10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63421 expref: 44 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.462160:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fabb17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63421 expref: 43 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.462168:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac790086a00) 00010000:00010000:0.0:1783969453.462170:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783969453.462172:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92e00, rc 0) 00000100:00100000:0.0:1783969453.462200:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+43:11556:x1870627272217088:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 683us (985us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1783969453.462205:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 202 00000100:00100000:3.0:1783969453.475971:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969453.476051:0:9934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272217344 00000100:00100000:0.0:1783969453.476061:0:9934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272217344 00000100:00100000:0.0:1783969453.476182:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 61 00000100:00100000:0.0:1783969453.476195:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+6:2349:x1870627272217344:12345-192.168.203.39@tcp:1:lfs.0 00010000:00010000:0.0:1783969453.476239:0:9934:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007eab34c7/0xbacf56d076fabb25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.476259:0:9934:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fabae6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6340c expref: 6 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.476268:0:9934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969453.476272:0:9934:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783969453.476276:0:9934:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007eab34c7/0xbacf56d076fabb25 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.476310:0:9934:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fabae6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6340c expref: 6 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.476324:0:9934:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fabae6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6340c expref: 6 pid: 6593 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969453.476339:0:9934:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff39880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9934:1870627280593536:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783969453.476426:0:9934:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7c18e2480 going to sleep for 11 seconds 00000100:00100000:2.0:1783969453.482615:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969453.482688:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272217472 00000100:00100000:3.0:1783969453.482696:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272217472 00002000:00100000:3.0:1783969453.482744:0:6599:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9ac681bf2a00 x1870627272217472/t0(0) o4->03985e57-ffb4-414b-b30c-e72697857d4f@192.168.203.39@tcp:349/0 lens 504/0 e 0 to 0 dl 1783969464 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783969453.482756:0:6599:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac681bf2a00 with x1870627272217472 ext(0->8) 00010000:00010000:3.0:1783969453.482765:0:6599:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fabae6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6340c expref: 7 pid: 6593 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.482797:0:6599:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fabae6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6340c expref: 7 pid: 6593 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783969453.482805:0:6599:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ac681bf2a00 00000100:00100000:3.0:1783969453.482839:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3 00000100:00100000:3.0:1783969453.482849:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:03985e57-ffb4-414b-b30c-e72697857d4f+7:2350:x1870627272217472:12345-192.168.203.39@tcp:4:lfs.0 00000100:00100000:3.0:1783969453.483547:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:03985e57-ffb4-414b-b30c-e72697857d4f+9:2350:x1870627272217472:12345-192.168.203.39@tcp:4:lfs.0 Request processed in 698us (940us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1783969453.483554:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3 00002000:00100000:3.0:1783969453.483563:0:6599:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9ac681bf2a00 x1870627272217472/t4294967308(0) o4->03985e57-ffb4-414b-b30c-e72697857d4f@192.168.203.39@tcp:349/0 lens 504/448 e 0 to 0 dl 1783969464 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783969453.483571:0:6599:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac681bf2a00 with x1870627272217472 ext(0->8) 00010000:00010000:3.0:1783969453.483584:0:6599:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fabae6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6340c expref: 9 pid: 6593 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.483597:0:6599:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fabae6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6340c expref: 9 pid: 6593 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783969453.483604:0:6599:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9ac681bf2a00 00000100:00100000:0.0:1783969453.484095:0:9934:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff39880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9934:1870627280593536:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783969453.484119:0:9934:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007eab34c7/0xbacf56d076fabb25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969453.500755:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969453.500951:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272217600 00000100:00100000:0.0:1783969453.500961:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272217600 00010000:00010000:0.0:1783969453.501002:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fabae6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6340c expref: 9 pid: 6593 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969453.501046:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 78 00000100:00100000:0.0:1783969453.501056:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+9:2349:x1870627272217600:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969453.501070:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783969453.501088:0:5778:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1783969453.501091:0:5778:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783969453 00002000:00010000:0.0:1783969453.501093:0:5778:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783969453 00002000:00010000:0.0:1783969453.501095:0:5778:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1783969453 00010000:00010000:0.0:1783969453.501100:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fabae6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6340c expref: 9 pid: 6593 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.501113:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fabae6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6340c expref: 9 pid: 6593 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.501138:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058d86b44/0xbacf56d076fabae6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6340c expref: 9 pid: 6593 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.501153:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783969453.501157:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783969453.501163:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007eab34c7/0xbacf56d076fabb25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.501192:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007eab34c7/0xbacf56d076fabb25 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.501228:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969453.501279:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+8:2349:x1870627272217600:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 224us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969453.501286:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 78 00010000:00010000:3.0:1783969453.501398:0:9934:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007eab34c7/0xbacf56d076fabb25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.501408:0:9934:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007eab34c7/0xbacf56d076fabb25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.501432:0:9934:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007eab34c7/0xbacf56d076fabb25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.501440:0:9934:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007eab34c7/0xbacf56d076fabb25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.501448:0:9934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007eab34c7/0xbacf56d076fabb25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.501455:0:9934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93e00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:3.0:1783969453.501459:0:9934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007eab34c7/0xbacf56d076fabb25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.501467:0:9934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007eab34c7/0xbacf56d076fabb25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.501487:0:9934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007eab34c7/0xbacf56d076fabb25 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.501494:0:9934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007eab34c7/0xbacf56d076fabb25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9934 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969453.501558:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+7:2349:x1870627272217344:12345-192.168.203.39@tcp:1:lfs.0 Request processed in 25366us (25597us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969453.501565:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 61 00000100:00100000:2.0:1783969453.504220:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969453.504294:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272217856 00000100:00100000:0.0:1783969453.504304:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272217856 00000100:00100000:0.0:1783969453.504360:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 56 00000100:00100000:0.0:1783969453.504369:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7861eb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+43:11556:x1870627272217856:12345-192.168.203.39@tcp:35:lfs.0 00000004:00010000:0.0:1783969453.504426:0:5797:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fabb17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63421 expref: 43 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783969453.504847:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1783969453.504955:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1783969453.505261:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:0.0:1783969453.505311:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabb2c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.505326:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabad1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633fe expref: 47 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.505335:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabb2c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.505367:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabad1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633fe expref: 47 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.505394:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabad1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633fe expref: 47 pid: 5795 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969453.505409:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff39880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5797:1870627280593664:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783969453.505495:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7c18e2480 going to sleep for 11 seconds 00000100:00100000:0.0:1783969453.509392:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff39880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5797:1870627280593664:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783969453.509425:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabb2c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969453.510202:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969453.510275:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272217984 00000100:00100000:0.0:1783969453.510282:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272217984 00010000:00010000:0.0:1783969453.510316:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabad1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633fe expref: 48 pid: 5795 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969453.510353:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 79 00000100:00100000:0.0:1783969453.510363:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03985e57-ffb4-414b-b30c-e72697857d4f+48:2351:x1870627272217984:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969453.510375:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969453.510382:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabad1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633fe expref: 48 pid: 5795 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.510395:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabad1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633fe expref: 48 pid: 5795 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.510417:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabad1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633fe expref: 48 pid: 5795 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.510451:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac790086a00) 00010000:00010000:0.0:1783969453.510455:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabb2c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.510464:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabb2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.510471:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabb2c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.510504:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969453.510556:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681bf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03985e57-ffb4-414b-b30c-e72697857d4f+47:2351:x1870627272217984:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 194us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969453.510564:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 79 00010000:00010000:1.0:1783969453.510847:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabb2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969453.510893:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabb2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783969453.511018:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:1.0:1783969453.511203:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1783969453.511306:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1665500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5797:1870627280593792:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783969453.511355:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969453.511388:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa459c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969453.511622:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280593792 00000100:00100000:0.0:1783969453.511628:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280593792 00000100:00100000:0.0:1783969453.511669:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783969453.511678:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5797:x1870627280593792:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783969453.511757:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5797:x1870627280593792:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 80us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969453.511765:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783969453.511837:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1665500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5797:1870627280593792:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1783969453.512309:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1783969453.512367:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5797:1870627280593920:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783969453.512404:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969453.512425:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b2faf480 going to sleep for 11 seconds 00000100:00100000:0.0:1783969453.512892:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280593920 00000100:00100000:0.0:1783969453.512897:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280593920 00000100:00100000:0.0:1783969453.512924:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783969453.512932:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5797:x1870627280593920:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783969453.513101:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5797:x1870627280593920:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 169us (695us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1783969453.513124:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783969453.514216:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5797:1870627280593920:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1783969453.514292:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1783969453.514343:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabb2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.514353:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabb2c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.514360:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabb2c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.514366:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969453.514381:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabb2c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.514388:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabb2c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.514403:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac790086a00) 00010000:00010000:3.0:1783969453.514406:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1783969453.514411:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabb2c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.514418:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabb2c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783969453.514798:0:5797:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1783969453.515793:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1783969453.515809:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 310597948458ns, next at 311597945891ns, rc = 0 00000001:00080000:3.0:1783969453.515818:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1783969453.515918:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac790086a00) 00010000:00010000:3.0:1783969453.515923:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783969453.515932:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fabb17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63421 expref: 51 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969453.516898:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7861eb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+50:11556:x1870627272217856:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 12526us (12682us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1783969453.516908:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 56 00000020:00080000:3.0:1783969453.516914:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1783969453.521467:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969453.521542:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272218112 00000100:00100000:3.0:1783969453.521551:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272218112 00000100:00100000:3.0:1783969453.521601:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 203 00000100:00100000:3.0:1783969453.521610:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac681bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+50:11556:x1870627272218112:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783969453.521640:0:10288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969453.521671:0:10288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fabb33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63428 expref: -99 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.521729:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fabb33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63428 expref: 51 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.521744:0:10288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fabb33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63428 expref: 51 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.521762:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:3.0:1783969453.521765:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783969453.521769:0:10288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de6a00, rc 0) 00000100:00100000:3.0:1783969453.521826:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac681bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+51:11556:x1870627272218112:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 216us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969453.521833:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 203 00000100:00100000:2.0:1783969453.527298:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969453.527382:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272218368 00000100:00100000:1.0:1783969453.527391:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272218368 00000100:00100000:1.0:1783969453.527452:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 57 00000100:00100000:1.0:1783969453.527462:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+51:11556:x1870627272218368:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1783969453.527758:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+52:11556:x1870627272218368:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 297us (468us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1783969453.527765:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 57 00010000:00010000:2.0:1783969453.605083:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969453.620672:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969453.621063:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272218496 00000100:00100000:0.0:1783969453.621073:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272218496 00000100:00100000:0.0:1783969453.621131:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 204 00000100:00100000:0.0:1783969453.621141:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+52:11566:x1870627272218496:12345-192.168.203.39@tcp:34:lfs.0 00010000:00010000:0.0:1783969453.621225:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabb3a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621242:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabb3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621254:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabb3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621270:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621278:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621285:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621371:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fabb48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621379:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fabb48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621386:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fabb48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783969453.621440:0:6618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fabb48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621453:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabb3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621459:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabb3a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621466:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabb3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621472:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969453.621475:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabb3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621481:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabb3a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621494:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:0.0:1783969453.621497:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969453.621501:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabb3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621508:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabb3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621520:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621526:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621539:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621544:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969453.621548:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621554:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621562:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ac790086400) 00010000:00010000:0.0:1783969453.621565:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969453.621567:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621573:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621587:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fabb48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621593:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fabb48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621599:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fabb48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621604:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969453.621607:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fabb48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621623:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fabb48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621631:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:0.0:1783969453.621633:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969453.621635:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fabb48 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.621653:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fabb48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969453.622041:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+52:11566:x1870627272218496:12345-192.168.203.39@tcp:34:lfs.0 Request processed in 898us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969453.622051:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 204 00000100:00100000:2.0:1783969453.625330:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969453.625374:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969453.625389:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272218624 00000100:00100000:1.0:1783969453.625399:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272218624 00000100:00100000:2.0:1783969453.625407:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969453.625443:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 291 00000100:00100000:1.0:1783969453.625452:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79188cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2348:x1870627272218624:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969453.625478:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272218752 00000100:00100000:3.0:1783969453.625483:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272218752 00000100:00100000:3.0:1783969453.625514:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 70 00000100:00100000:3.0:1783969453.625521:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+9:2348:x1870627272218752:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969453.625584:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798164700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+9:2348:x1870627272218752:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 63us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969453.625592:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 70 00000100:00100000:0.0:1783969453.625754:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272218880 00000100:00100000:0.0:1783969453.625758:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272218880 00000100:00100000:0.0:1783969453.625804:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 145 00000100:00100000:1.0:1783969453.625805:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79188cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2348:x1870627272218624:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 353us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969453.625810:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac798167100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2348:x1870627272218880:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969453.625882:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac798167100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2348:x1870627272218880:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 51us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969453.625888:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 145 00000100:00080000:3.0:1783969453.625973:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969453.643358:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 291 00000100:00100000:2.0:1783969453.654534:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969453.654630:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272219136 00000100:00100000:0.0:1783969453.654639:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272219136 00000100:00100000:0.0:1783969453.654720:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 205 00000100:00100000:0.0:1783969453.654731:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+52:11569:x1870627272219136:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783969453.654752:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969453.654772:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fabb4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6342f expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.654889:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb56 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.654904:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.654915:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.654930:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabb5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.654937:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabb5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.654944:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabb5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.655060:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabb64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.655069:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabb64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.655076:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabb64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969453.655085:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1783969453.655191:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.655198:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb56 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.655210:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.655216:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969453.655220:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.655228:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb56 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.655240:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:0.0:1783969453.655243:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969453.655249:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.655255:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.655269:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabb5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.655276:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabb5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.655281:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabb5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.655285:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969453.655288:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabb5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.655302:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabb5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.655311:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ac790086400) 00010000:00010000:0.0:1783969453.655313:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969453.655316:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabb5d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.655322:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabb5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.655361:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93000/0xbacf56d076fabb4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6342f expref: 55 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.655375:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabb64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6342f expref: 54 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.655382:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:0.0:1783969453.655384:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969453.655386:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93c00, rc 0) 00000100:00100000:0.0:1783969453.655451:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+54:11569:x1870627272219136:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 722us (925us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1783969453.655460:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 205 00000100:00100000:0.0:1783969453.659251:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969453.659337:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272219264 00000100:00100000:3.0:1783969453.659347:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272219264 00000100:00100000:3.0:1783969453.659404:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 206 00000100:00100000:3.0:1783969453.659427:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+54:11569:x1870627272219264:12345-192.168.203.39@tcp:54:lfs.0 00010000:00010000:3.0:1783969453.659495:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabb72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.659511:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabb72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.659524:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabb72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.659550:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabb72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.659556:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabb72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.659563:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabb72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.659569:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de7600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969453.659573:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabb72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.659580:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabb72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.659591:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:3.0:1783969453.659595:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783969453.659600:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabb72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.659606:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabb72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969453.659699:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+54:11569:x1870627272219264:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 273us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969453.659767:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 206 00000100:00100000:3.0:1783969453.662708:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969453.662787:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272219520 00000100:00100000:1.0:1783969453.662797:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272219520 00000100:00100000:1.0:1783969453.662935:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 58 00000100:00100000:1.0:1783969453.662967:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+54:11569:x1870627272219520:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1783969453.663198:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+55:11569:x1870627272219520:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 233us (497us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1783969453.663206:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 58 00000100:00100000:2.0:1783969453.739118:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969453.739209:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272219776 00000100:00100000:0.0:1783969453.739219:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272219776 00000100:00100000:0.0:1783969453.739277:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 207 00000100:00100000:0.0:1783969453.739286:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+55:11579:x1870627272219776:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:0.0:1783969453.739321:0:10288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969453.739324:0:10288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783969453.739347:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabaf4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63413 expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.739364:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:0.0:1783969453.739369:0:10288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783969453.739380:0:10288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabb79 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63436 expref: -99 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.739475:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb80 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.739488:0:10288:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabb64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6342f expref: 55 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.739496:0:10288:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb80 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.739526:0:10288:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabb64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6342f expref: 55 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.739539:0:10288:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabb64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6342f expref: 55 pid: 5793 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969453.739553:0:10288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff39c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10288:1870627280594048:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783969453.739636:0:10288:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7c18e2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783969453.743501:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969453.743649:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272219904 00000100:00100000:2.0:1783969453.743658:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272219904 00010000:00010000:2.0:1783969453.743694:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabb64 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6342f expref: 56 pid: 5793 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969453.743745:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 80 00000100:00100000:2.0:1783969453.743754:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+56:2351:x1870627272219904:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969453.743768:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969453.743780:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabb64 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6342f expref: 56 pid: 5793 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969453.743792:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabb64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6342f expref: 56 pid: 5793 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969453.743815:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:2.0:1783969453.743819:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb80 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969453.743829:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb80 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969453.743836:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb80 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969453.743898:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969453.743950:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+56:2351:x1870627272219904:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 197us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969453.743959:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 80 00010000:00010000:3.0:1783969453.744478:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabb64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6342f expref: 55 pid: 5793 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969453.744496:0:10288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff39c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10288:1870627280594048:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783969453.744517:0:10288:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb80 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.744525:0:10288:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb80 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.744531:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb80 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969453.744548:0:10288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1783969453.744701:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabb79 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63436 expref: 56 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.744729:0:10288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb80 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63436 expref: 55 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.744738:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:3.0:1783969453.744741:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783969453.744743:0:10288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93800, rc 0) 00000100:00100000:3.0:1783969453.744793:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+55:11579:x1870627272219776:12345-192.168.203.39@tcp:101:bash.0 Request processed in 5509us (5684us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1783969453.744800:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 207 00000100:00100000:0.0:1783969453.749765:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969453.749920:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272220160 00000100:00100000:1.0:1783969453.749929:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272220160 00000100:00100000:1.0:1783969453.749978:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 208 00000100:00100000:1.0:1783969453.749988:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+55:11579:x1870627272220160:12345-192.168.203.39@tcp:36:bash.0 00010000:00010000:1.0:1783969453.750269:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fabb8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969453.750287:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fabb8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969453.750299:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fabb8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783969453.750354:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:1.0:1783969453.750379:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008f568f54 reply state 00000000575bbf98 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fabb8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969453.750388:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783969453.750486:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+58:11579:x1870627272220160:12345-192.168.203.39@tcp:36:bash.0 Request processed in 498us (730us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1783969453.750509:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 208 00000020:00080000:1.0:1783969453.750514:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783969453.752974:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fabb8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969453.752990:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fabb8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969453.752997:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fabb8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969453.753004:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60f400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969453.753008:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fabb8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969453.753016:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fabb8e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969453.753033:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:1.0:1783969453.753037:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969453.753041:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fabb8e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969453.753047:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fabb8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969453.754763:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969453.754891:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272220288 00000100:00100000:3.0:1783969453.754901:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272220288 00000100:00100000:3.0:1783969453.754953:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 209 00000100:00100000:3.0:1783969453.754963:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+57:11579:x1870627272220288:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:3.0:1783969453.754986:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969453.755006:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabb95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6343d expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.755084:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabb9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.755099:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb80 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63436 expref: 58 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.755107:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabb9c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.755141:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb80 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63436 expref: 58 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.755155:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb80 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63436 expref: 58 pid: 10288 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969453.755175:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1870627280594176:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783969453.755258:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b2fe0300 going to sleep for 11 seconds 00000100:00100000:2.0:1783969453.758064:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969453.758150:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272220416 00000100:00100000:0.0:1783969453.758168:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272220416 00010000:00010000:0.0:1783969453.758207:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb80 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63436 expref: 59 pid: 10288 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969453.758249:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 81 00000100:00100000:0.0:1783969453.758259:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682511c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03985e57-ffb4-414b-b30c-e72697857d4f+59:2351:x1870627272220416:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969453.758273:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969453.758280:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb80 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63436 expref: 59 pid: 10288 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.758294:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb80 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63436 expref: 59 pid: 10288 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.758316:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:0.0:1783969453.758320:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabb9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.758330:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabb9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.758337:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabb9c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.758356:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969453.758585:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682511c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03985e57-ffb4-414b-b30c-e72697857d4f+59:2351:x1870627272220416:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 326us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969453.758612:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 81 00010000:00010000:3.0:1783969453.759042:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabb80 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63436 expref: 58 pid: 10288 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969453.759063:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1870627280594176:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783969453.759092:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabb9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.759101:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabb9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.759106:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabb9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969453.759151:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783969453.759164:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783969453.759184:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabb9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.759214:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabb95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6343d expref: 58 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.759228:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabb9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6343d expref: 57 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.759236:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:3.0:1783969453.759239:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783969453.759242:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de6800, rc 0) 00000100:00100000:3.0:1783969453.759275:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+57:11579:x1870627272220288:12345-192.168.203.39@tcp:101:bash.0 Request processed in 4314us (4522us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969453.759282:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 209 00000100:00100000:2.0:1783969453.764897:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969453.764985:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272220672 00000100:00100000:1.0:1783969453.764995:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272220672 00000100:00100000:1.0:1783969453.765047:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 59 00000100:00100000:1.0:1783969453.765057:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+57:11579:x1870627272220672:12345-192.168.203.39@tcp:35:bash.0 00000100:00100000:1.0:1783969453.765318:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+58:11579:x1870627272220672:12345-192.168.203.39@tcp:35:bash.0 Request processed in 262us (471us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1783969453.765327:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 59 00000100:00100000:1.0:1783969453.831464:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969453.831628:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272220800 00000100:00100000:3.0:1783969453.831638:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272220800 00000100:00100000:3.0:1783969453.831721:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 210 00000100:00100000:3.0:1783969453.831731:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+58:11585:x1870627272220800:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783969453.831755:0:10288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969453.831776:0:10288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabba3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63444 expref: -99 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.831842:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fabbaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.831893:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fabbaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.831906:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fabbaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969453.831964:0:10288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1783969453.831968:0:10288:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783969453.831992:0:10288:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fabbaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.832016:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabba3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63444 expref: 60 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.832034:0:10288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fabbaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63444 expref: 59 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.832043:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:3.0:1783969453.832046:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783969453.832064:0:10288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7400, rc 0) 00000100:00100000:3.0:1783969453.832418:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+59:11585:x1870627272220800:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 674us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969453.832426:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 210 00000100:00100000:2.0:1783969453.836563:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969453.837272:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272220928 00000100:00100000:3.0:1783969453.837284:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272220928 00000100:00100000:3.0:1783969453.837395:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 211 00000100:00100000:3.0:1783969453.837406:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac682510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+59:11585:x1870627272220928:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783969453.837424:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969453.837455:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fabbb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6344b expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.837518:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabbb8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.837533:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabbb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.837545:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabbb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.837560:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496c00/0xbacf56d076fabbbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.837566:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496c00/0xbacf56d076fabbbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.837572:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496c00/0xbacf56d076fabbbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.837679:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781497600/0xbacf56d076fabbc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.837700:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781497600/0xbacf56d076fabbc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.837721:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781497600/0xbacf56d076fabbc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969453.837756:0:6618:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783969453.837761:0:6618:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783969453.837777:0:6618:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781497600/0xbacf56d076fabbc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.837788:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781497600/0xbacf56d076fabbc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.837796:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabbb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.837803:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabbb8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.837809:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabbb8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.837815:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969453.837819:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabbb8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.837827:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabbb8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.837838:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:3.0:1783969453.837842:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969453.838589:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabbb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.838599:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabbb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.838616:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496c00/0xbacf56d076fabbbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.838622:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496c00/0xbacf56d076fabbbf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.838628:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496c00/0xbacf56d076fabbbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.838634:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac781496c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969453.838637:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496c00/0xbacf56d076fabbbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.838792:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496c00/0xbacf56d076fabbbf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.838804:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ac78c550500) 00010000:00010000:3.0:1783969453.838807:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969453.838810:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496c00/0xbacf56d076fabbbf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.838815:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496c00/0xbacf56d076fabbbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.838968:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fabbb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6344b expref: 61 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.838999:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781497600/0xbacf56d076fabbc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6344b expref: 60 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.839005:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:3.0:1783969453.839008:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783969453.839010:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac781497600, rc 0) 00000100:00100000:3.0:1783969453.839126:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac682510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+60:11585:x1870627272220928:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1721us (2571us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969453.839135:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 211 00000100:00100000:2.0:1783969453.844664:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969453.844820:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969453.845045:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272221312 00000100:00100000:3.0:1783969453.845055:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272221312 00000100:00100000:0.0:1783969453.845089:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272221056 00000100:00100000:0.0:1783969453.845096:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272221056 00000100:00100000:3.0:1783969453.845115:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 212 00000100:00100000:3.0:1783969453.845128:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+61:11585:x1870627272221312:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783969453.845147:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969453.845179:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076fabbcd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63452 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.845284:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabbd4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.845300:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabb9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6343d expref: 62 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.845308:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781497600/0xbacf56d076fabbc6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6344b expref: 62 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.845335:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabbd4 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.845369:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781497600/0xbacf56d076fabbc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6344b expref: 62 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.845384:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781497600/0xbacf56d076fabbc6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6344b expref: 62 pid: 6618 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969453.845398:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1870627280594304:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783969453.845461:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781497600/0xbacf56d076fabbc6 lrc: 6/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6344b expref: 62 pid: 6618 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969453.845490:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 82 00000100:00100000:0.0:1783969453.845498:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7860bec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+62:2350:x1870627272221056:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969453.845507:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969453.845512:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781497600/0xbacf56d076fabbc6 lrc: 6/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6344b expref: 62 pid: 6618 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.845524:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781497600/0xbacf56d076fabbc6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6344b expref: 62 pid: 6618 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.845540:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:0.0:1783969453.845545:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabbd4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.845551:0:5778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabbd4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.845557:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783969453.845636:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabb9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6343d expref: 62 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.845647:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabb9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6343d expref: 62 pid: 5795 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969453.845655:0:5795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1870627280594432:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783969453.846366:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7860bec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+62:2350:x1870627272221056:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 867us (1713us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969453.846375:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 82 00000100:00100000:3.0:1783969453.846548:0:5795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b2fe0300 going to sleep for 11 seconds 00010000:00010000:3.0:1783969453.850918:0:5795:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.39@tcp) returned -22 from blocking AST (req@0000000001c886e5 x1870627280594304) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781497600/0xbacf56d076fabbc6 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6344b expref: 61 pid: 6618 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.850943:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781497600/0xbacf56d076fabbc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6344b expref: 61 pid: 6618 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969453.851002:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1870627280594304:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783969453.851030:0:5795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5795:1870627280594432:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783969453.851066:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:3.0:1783969453.851072:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabbd4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.851082:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabbd4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.851091:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabbd4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969453.851499:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969453.851566:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272221440 00000100:00100000:3.0:1783969453.851573:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272221440 00010000:00010000:3.0:1783969453.851607:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabb9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6343d expref: 61 pid: 5795 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969453.851650:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 83 00000100:00100000:3.0:1783969453.851660:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+61:2351:x1870627272221440:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969453.851673:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969453.851679:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabb9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6343d expref: 61 pid: 5795 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.851691:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabb9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6343d expref: 61 pid: 5795 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.851710:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabb9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6343d expref: 61 pid: 5795 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.851734:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:3.0:1783969453.851738:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabbd4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.851746:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabbd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.851753:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabbd4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969453.851842:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969453.851947:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+60:2351:x1870627272221440:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 288us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969453.851955:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 83 00010000:00010000:1.0:1783969453.856321:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabbd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969453.856339:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabbd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969453.856363:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1783969453.856765:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac781496200/0xbacf56d076fabbcd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63452 expref: 61 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969453.856790:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabbd4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63452 expref: 60 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969453.856800:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:1.0:1783969453.856803:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783969453.856806:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7600, rc 0) 00000100:00100000:1.0:1783969453.856981:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+60:11585:x1870627272221312:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 11854us (12159us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1783969453.856990:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 212 00000100:00100000:2.0:1783969453.860254:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969453.860343:0:8304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272221696 00000100:00100000:1.0:1783969453.860352:0:8304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272221696 00000100:00100000:1.0:1783969453.860455:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00100000:1.0:1783969453.860534:0:8304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+60:11585:x1870627272221696:12345-192.168.203.39@tcp:103:lfs.0 00010000:00010000:1.0:1783969453.860567:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969453.860591:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fabb33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63428 expref: 60 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969453.860609:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:1.0:1783969453.860613:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969453.860716:0:8304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+59:11585:x1870627272221696:12345-192.168.203.39@tcp:103:lfs.0 Request processed in 251us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969453.860723:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00100000:2.0:1783969453.863010:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969453.863141:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272221824 00000100:00100000:1.0:1783969453.863149:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272221824 00000100:00100000:1.0:1783969453.863211:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 213 00000100:00100000:1.0:1783969453.863220:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+59:11585:x1870627272221824:12345-192.168.203.39@tcp:58:lfs.0 00010000:00010000:1.0:1783969453.863322:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fabbe2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969453.863338:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fabbe2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969453.863349:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fabbe2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783969453.863532:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1783969453.863609:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+59:11585:x1870627272221824:12345-192.168.203.39@tcp:58:lfs.0 Request processed in 389us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969453.863617:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 213 00000100:00100000:3.0:1783969453.867402:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969453.867487:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272221952 00000100:00100000:0.0:1783969453.867511:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272221952 00000100:00100000:0.0:1783969453.867569:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 214 00000100:00100000:0.0:1783969453.867579:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+59:11585:x1870627272221952:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783969453.867598:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969453.867622:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabbe9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63459 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.867684:0:6618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fabbe2 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.867696:0:6618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabbe9 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63459 expref: 60 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.867724:0:6618:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fabbe2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.867737:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabbe9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63459 expref: 60 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.867750:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:0.0:1783969453.867752:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783969453.867756:0:6618:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabbe9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63459 expref: 60 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969453.867764:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93800, rc 0) 00000100:00100000:0.0:1783969453.867827:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+60:11585:x1870627272221952:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 248us (1258us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969453.867835:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 214 00000040:00080000:3.0:1783969454.437207:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783969454.437215:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783969454.437270:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1783969454.437277:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783969454.437398:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbd500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1870627280594560:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783969454.437504:0:11535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b2fe0540 going to sleep for 11 seconds 00000100:00100000:3.0:1783969454.442144:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969454.442359:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272222080 00000100:00100000:1.0:1783969454.442368:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272222080 00000100:00100000:1.0:1783969454.442449:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 215 00000100:00100000:1.0:1783969454.442459:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+61:11586:x1870627272222080:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783969454.442489:0:5795:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783969454.442585:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+61:11586:x1870627272222080:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 Request processed in 128us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969454.442592:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 215 00000100:00100000:0.0:1783969454.442594:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbd500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1870627280594560:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783969454.462235:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969454.462323:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272222208 00000100:00100000:0.0:1783969454.462332:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272222208 00000100:00100000:0.0:1783969454.462392:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 216 00000100:00100000:0.0:1783969454.462402:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+60:11586:x1870627272222208:12345-192.168.203.39@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1783969454.462484:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabbf0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462499:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabbf0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462511:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabbf0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462524:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabbf7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462530:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabbf7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462537:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabbf7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462557:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabbfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462565:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabbfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462571:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabbfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969454.462628:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1783969454.462632:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783969454.462643:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabbfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462653:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabbf0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462659:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabbf0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462665:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabbf0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462670:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969454.462674:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabbf0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462680:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabbf0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462693:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac790086e00) 00010000:00010000:0.0:1783969454.462696:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969454.462701:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabbf0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462707:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabbf0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462720:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabbf7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462735:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabbf7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462742:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabbf7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462746:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969454.462749:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabbf7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462755:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabbf7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462762:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9ac790086400) 00010000:00010000:0.0:1783969454.462764:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969454.462767:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabbf7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462773:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabbf7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462786:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabbfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462792:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabbfe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462798:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabbfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462803:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969454.462814:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabbfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462821:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabbfe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462828:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:0.0:1783969454.462831:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969454.462833:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabbfe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.462839:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabbfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969454.462962:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+60:11586:x1870627272222208:12345-192.168.203.39@tcp:34:lhsmtool_posix.0 Request processed in 561us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969454.462971:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 216 00000100:00100000:2.0:1783969454.483240:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969454.483350:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272222464 00000100:00100000:1.0:1783969454.483359:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272222464 00000100:00100000:1.0:1783969454.483412:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 217 00000100:00100000:1.0:1783969454.483430:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+60:11586:x1870627272222464:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783969454.483448:0:10288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969454.483467:0:10288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fabc05 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63460 expref: -99 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.483550:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.483565:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.483576:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969454.483586:0:10288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1783969454.483673:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.483681:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.483698:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.483705:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60ea00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969454.483709:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.483717:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.483728:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:1.0:1783969454.483731:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783969454.483735:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.483742:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.483781:0:10288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fabc05 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63460 expref: 62 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.483791:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac790086e00) 00010000:00010000:1.0:1783969454.483794:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783969454.483798:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fabc05 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63460 expref: 62 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.483806:0:10288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bf60f200, rc 0) 00000100:00100000:1.0:1783969454.483916:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+61:11586:x1870627272222464:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 496us (685us total) trans 4294967504 rc 301/301 00000100:00100000:1.0:1783969454.483934:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 217 00000100:00100000:1.0:1783969454.487687:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969454.487771:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272222592 00000100:00100000:3.0:1783969454.487780:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272222592 00000100:00100000:3.0:1783969454.487835:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 218 00000100:00100000:3.0:1783969454.487854:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+61:11586:x1870627272222592:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783969454.487913:0:5795:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783969454.488027:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+61:11586:x1870627272222592:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 Request processed in 182us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969454.488036:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 218 00000100:00100000:3.0:1783969454.492407:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969454.492515:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272222848 00000100:00100000:0.0:1783969454.492524:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272222848 00000100:00100000:0.0:1783969454.492631:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 219 00000100:00100000:0.0:1783969454.492651:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+61:11586:x1870627272222848:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783969454.492672:0:6618:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969454.492675:0:6618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783969454.492716:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fabbaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63444 expref: 61 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.492735:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:0.0:1783969454.492740:0:6618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783969454.492754:0:6618:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabc1a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63467 expref: -99 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783969454.493456:0:6618:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1783969454.493651:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabc21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.493665:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabc21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.493675:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabc21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.493742:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabc1a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63467 expref: 63 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.493758:0:6618:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabc21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63467 expref: 62 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.493765:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ac790086400) 00010000:00010000:0.0:1783969454.493767:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969454.493770:0:6618:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93c00, rc 0) 00000100:00100000:0.0:1783969454.493838:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+62:11586:x1870627272222848:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 1197us (1439us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1783969454.493855:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 219 00000100:00100000:2.0:1783969454.497776:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969454.498909:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272223104 00000100:00100000:1.0:1783969454.498920:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272223104 00000100:00100000:1.0:1783969454.498983:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 220 00000100:00100000:1.0:1783969454.498994:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+62:11586:x1870627272223104:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783969454.499060:0:10288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969454.499087:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabc21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63467 expref: 62 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.500112:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ac790086400) 00010000:00010000:1.0:1783969454.500129:0:10288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783969454.500276:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fabc2f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.500292:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fabc2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.500303:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fabc2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.500348:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xf4867621 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.500355:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf4867621 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.500360:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf4867621 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.500446:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fabc2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.500453:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fabc2f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.500458:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fabc2f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.500463:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60f200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969454.500467:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fabc2f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.500473:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fabc2f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.501033:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:1.0:1783969454.501036:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969454.501040:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fabc2f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.501047:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fabc2f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.501058:0:10288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf4867621 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.501064:0:10288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf4867621 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.501070:0:10288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf4867621 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.501083:0:10288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60ea00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969454.501087:0:10288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf4867621 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.501093:0:10288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf4867621 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.501100:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xf4867621 (ffff9ac7829e0d00) 00010000:00010000:1.0:1783969454.501102:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969454.501105:0:10288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc36 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf4867621 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.501110:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf4867621 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969454.501350:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+61:11586:x1870627272223104:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 2354us (3580us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783969454.501358:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 220 00000100:00100000:3.0:1783969454.504486:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969454.504550:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272223232 00000100:00100000:0.0:1783969454.504558:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272223232 00000100:00100000:0.0:1783969454.504605:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 221 00000100:00100000:0.0:1783969454.504614:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+61:11586:x1870627272223232:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783969454.504631:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969454.504670:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabc3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6346e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.504708:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fabc44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.504721:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fabc44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.504732:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fabc44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.504832:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabc3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6346e expref: 63 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.504895:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fabc44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6346e expref: 62 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.504903:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ac790086b00) 00010000:00010000:0.0:1783969454.504906:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783969454.504910:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93e00, rc 0) 00000100:00100000:0.0:1783969454.504963:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+62:11586:x1870627272223232:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 349us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969454.504970:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 221 00000100:00100000:2.0:1783969454.510363:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969454.510445:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272223488 00000100:00100000:1.0:1783969454.510454:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272223488 00000100:00100000:1.0:1783969454.510507:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 222 00000100:00100000:1.0:1783969454.510517:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+62:11586:x1870627272223488:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783969454.510595:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.510610:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.510619:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783969454.510904:0:10288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1783969454.510914:0:10288:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 311593054536ns, next at 312593052156ns, rc = 0 00000004:00010000:1.0:1783969454.510997:0:10288:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000064a92f99 reply state 00000000c6812f73 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969454.511006:0:10288:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783969454.511622:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+64:11586:x1870627272223488:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 1104us (1264us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1783969454.511630:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 222 00010000:00010000:2.0:1783969454.514256:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969454.514273:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969454.514281:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969454.514288:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60ea00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969454.514292:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969454.514299:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc4b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969454.514316:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ac790086b00) 00010000:00010000:2.0:1783969454.514319:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783969454.514323:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc4b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969454.514331:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabc4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969454.516390:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969454.516528:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272223616 00000100:00100000:3.0:1783969454.516538:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272223616 00000100:00100000:3.0:1783969454.516593:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 223 00000100:00100000:3.0:1783969454.516603:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+63:11586:x1870627272223616:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969454.516626:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969454.516657:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabc52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63475 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.516725:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabc52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63475 expref: 64 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.516739:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabc52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63475 expref: 64 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.516756:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ac790086b00) 00010000:00010000:3.0:1783969454.516760:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783969454.516763:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de6800, rc 0) 00000100:00100000:3.0:1783969454.516827:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+64:11586:x1870627272223616:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 226us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969454.516834:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 223 00000100:00100000:3.0:1783969454.522298:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969454.522421:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272223744 00000100:00100000:2.0:1783969454.522430:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272223744 00000100:00100000:2.0:1783969454.522496:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 62 00000100:00100000:2.0:1783969454.522505:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+9:2351:x1870627272223744:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1783969454.522784:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+10:2351:x1870627272223744:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 Request processed in 279us (492us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1783969454.522792:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 62 00000100:00080000:3.0:1783969454.523668:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969454.529957:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969454.530054:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272224000 00000100:00100000:2.0:1783969454.530062:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272224000 00000100:00100000:2.0:1783969454.530111:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 60 00000100:00100000:2.0:1783969454.530121:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+64:11586:x1870627272224000:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783969454.530527:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+65:11586:x1870627272224000:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 405us (576us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1783969454.530535:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 60 00000100:00100000:1.0:1783969454.534147:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969454.534399:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272224256 00000100:00100000:2.0:1783969454.534408:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272224256 00000100:00100000:2.0:1783969454.534457:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 224 00000100:00100000:2.0:1783969454.534467:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+65:11586:x1870627272224256:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783969454.534570:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+65:11586:x1870627272224256:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 104us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969454.534578:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 224 00000100:00100000:0.0:1783969454.538343:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969454.538426:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272224384 00000100:00100000:1.0:1783969454.538434:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272224384 00000100:00100000:1.0:1783969454.538483:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 225 00000100:00100000:1.0:1783969454.538492:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+65:11586:x1870627272224384:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783969454.538510:0:10288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969454.538528:0:10288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e600/0xbacf56d076fabc59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6347c expref: -99 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.538583:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fabc60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.538597:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fabc60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.538608:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fabc60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969454.538665:0:10288:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783969454.538682:0:10288:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fabc60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.538946:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e600/0xbacf56d076fabc59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6347c expref: 67 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.538963:0:10288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fabc60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6347c expref: 66 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.538971:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ac790086b00) 00010000:00010000:1.0:1783969454.538974:0:10288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783969454.538977:0:10288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bf60f800, rc 0) 00000100:00100000:1.0:1783969454.539079:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+66:11586:x1870627272224384:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 588us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969454.539086:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 225 00000100:00100000:1.0:1783969454.544123:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969454.544357:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272224512 00000100:00100000:3.0:1783969454.544367:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272224512 00000100:00100000:3.0:1783969454.544466:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 63 00000100:00100000:3.0:1783969454.544476:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a76c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+10:2349:x1870627272224512:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969454.544493:0:6594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969454.544514:0:6594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047ed865b/0xbacf56d076fabc67 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63483 expref: -99 pid: 6594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783969454.544540:0:6594:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5536ae, blocks: 0x1 00010000:00010000:3.0:1783969454.544558:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=311s v=(0 0) 00010000:00010000:3.0:1783969454.544563:0:6594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969454.544572:0:6594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047ed865b/0xbacf56d076fabc67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63483 expref: 11 pid: 6594 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.544591:0:6594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000047ed865b/0xbacf56d076fabc67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63483 expref: 11 pid: 6594 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.544605:0:6594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7800, rc 0) 00000100:00100000:3.0:1783969454.544677:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a76c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+11:2349:x1870627272224512:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 202us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969454.544684:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 63 00000100:00100000:2.0:1783969454.547932:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969454.548022:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272224768 00000100:00100000:0.0:1783969454.548031:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272224768 00000100:00100000:0.0:1783969454.548289:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 226 00000100:00100000:0.0:1783969454.548300:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1beb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+66:11586:x1870627272224768:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783969454.549321:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1beb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+66:11586:x1870627272224768:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 1022us (1627us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969454.549330:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 226 00000100:00100000:1.0:1783969454.554025:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969454.554967:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272224896 00000100:00100000:2.0:1783969454.554979:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272224896 00000100:00100000:2.0:1783969454.555037:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 64 00000100:00100000:2.0:1783969454.555057:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+11:11586:x1870627272224896:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783969454.555074:0:6595:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969454.555091:0:6595:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c466b656/0xbacf56d076fabc6e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6348a expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969454.555137:0:6595:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000047ed865b/0xbacf56d076fabc67 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63483 expref: 12 pid: 6594 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969454.555146:0:6595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969454.555159:0:6595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969454.555165:0:6595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c466b656/0xbacf56d076fabc6e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6348a expref: 12 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969454.555199:0:6595:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000047ed865b/0xbacf56d076fabc67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63483 expref: 12 pid: 6594 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969454.555445:0:6595:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000047ed865b/0xbacf56d076fabc67 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63483 expref: 12 pid: 6594 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969454.555463:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1be9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6595:1870627280594688:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783969454.555558:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bf56ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1783969454.559346:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1be9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6595:1870627280594688:192.168.203.39@tcp:104: 00010000:00010000:3.0:1783969454.559381:0:6595:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c466b656/0xbacf56d076fabc6e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6348a expref: 12 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.559400:0:6595:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786098600, rc 0) 00000100:00100000:3.0:1783969454.559472:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+12:11586:x1870627272224896:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 4425us (5454us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969454.559480:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 64 00000100:00100000:2.0:1783969454.561938:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969454.562087:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272225024 00000100:00100000:0.0:1783969454.562096:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272225024 00010000:00010000:0.0:1783969454.562136:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000047ed865b/0xbacf56d076fabc67 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63483 expref: 12 pid: 6594 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969454.562184:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 84 00000100:00100000:0.0:1783969454.562193:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+12:2351:x1870627272225024:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969454.562207:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969454.562421:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000047ed865b/0xbacf56d076fabc67 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63483 expref: 12 pid: 6594 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.562437:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000047ed865b/0xbacf56d076fabc67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63483 expref: 12 pid: 6594 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.562460:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047ed865b/0xbacf56d076fabc67 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63483 expref: 12 pid: 6594 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.562476:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969454.562480:0:5779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969454.562488:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c466b656/0xbacf56d076fabc6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6348a expref: 11 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.562516:0:5779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c466b656/0xbacf56d076fabc6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6348a expref: 11 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.562557:0:5779:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c466b656/0xbacf56d076fabc6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6348a expref: 11 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969454.562584:0:5779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff38700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5779:1870627280594816:192.168.203.39@tcp:105: 00000100:00100000:0.0:1783969454.562671:0:5779:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7c18e2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783969454.571408:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969454.571487:0:6598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272225152 00000100:00100000:2.0:1783969454.571495:0:6598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272225152 00002000:00100000:2.0:1783969454.571539:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9ac7bf6b2300 x1870627272225152/t0(0) o4->03985e57-ffb4-414b-b30c-e72697857d4f@192.168.203.39@tcp:350/0 lens 504/0 e 0 to 0 dl 1783969465 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783969454.571550:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac7bf6b2300 with x1870627272225152 ext(0->12) 00002000:00010000:2.0:1783969454.571556:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ac7bf6b2300 00000100:00100000:2.0:1783969454.571582:0:6598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:2.0:1783969454.571602:0:6598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:03985e57-ffb4-414b-b30c-e72697857d4f+12:2350:x1870627272225152:12345-192.168.203.39@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783969454.572412:0:6598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:03985e57-ffb4-414b-b30c-e72697857d4f+14:2350:x1870627272225152:12345-192.168.203.39@tcp:4:lhsmtool_posix.0 Request processed in 807us (1008us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1783969454.572420:0:6598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6 00002000:00100000:2.0:1783969454.572428:0:6598:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9ac7bf6b2300 x1870627272225152/t4294967320(0) o4->03985e57-ffb4-414b-b30c-e72697857d4f@192.168.203.39@tcp:350/0 lens 504/448 e 0 to 0 dl 1783969465 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783969454.572438:0:6598:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac7bf6b2300 with x1870627272225152 ext(0->12) 00002000:00010000:2.0:1783969454.572442:0:6598:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ac7bf6b2300 00000100:00100000:1.0:1783969454.575617:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969454.576085:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272225280 00000100:00100000:3.0:1783969454.576094:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272225280 00000100:00100000:3.0:1783969454.576161:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 227 00000100:00100000:3.0:1783969454.576171:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+66:11586:x1870627272225280:12345-192.168.203.39@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1783969454.582630:0:5779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff38700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5779:1870627280594816:192.168.203.39@tcp:105: 00010000:00010000:0.0:1783969454.582662:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969454.583583:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+13:2351:x1870627272225024:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 21386us (21649us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969454.583597:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 84 00000001:00080000:2.0:1783969454.614110:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:2.0:1783969454.614147:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1783969454.614190:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ac7c18e2300 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1783969454.614195:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ac7912f2e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ac7c18e23c0 00000020:00080000:2.0:1783969454.614199:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ac7912f2a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ac7ba17c800 00000001:00080000:2.0:1783969454.614224:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1783969454.614228:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000001:00080000:2.0:1783969454.614261:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000020:00080000:2.0:1783969454.614269:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:2.0:1783969454.614281:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1783969454.614294:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ac7b2faf840 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1783969454.614297:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ac785661c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ac7b2faf600 00000020:00080000:2.0:1783969454.614300:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ac785661b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ac7981b6400 00000020:00080000:2.0:1783969454.614321:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1783969454.614503:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1783969454.614612:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1be9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280594944:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783969454.614717:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969454.615020:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280594944 00000100:00100000:0.0:1783969454.615026:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280594944 00000100:00100000:0.0:1783969454.615078:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783969454.615087:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3287:x1870627280594944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783969454.615109:0:6593:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1783969454.615137:0:6593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a5536ad, atime: 0x6a5536ad, ctime: 0x6a5536ad, blocks: 0x1 00010000:00010000:0.0:1783969454.615145:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4b79086/0xbacf56d076fabc75 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.615161:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=311s v=(0 0) 00010000:00010000:0.0:1783969454.615165:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969454.615173:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4b79086/0xbacf56d076fabc75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.615189:0:6593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4b79086/0xbacf56d076fabc75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.615205:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4b79086/0xbacf56d076fabc75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.615222:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4b79086/0xbacf56d076fabc75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.615239:0:6593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783969454.615780:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786093480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3287:x1870627280594944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 691us (1060us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1783969454.615789:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783969454.615820:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280595200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1783969454.615896:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783969454.615934:0:8303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969454.615941:0:8303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4b79086/0xbacf56d076fabc75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.615950:0:8303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93000 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969454.615955:0:8303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4b79086/0xbacf56d076fabc75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.615963:0:8303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4b79086/0xbacf56d076fabc75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.615980:0:8303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4b79086/0xbacf56d076fabc75 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.616001:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4b79086/0xbacf56d076fabc75 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.616019:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969454.616021:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969454.616022:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969454.616033:0:9934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280595200 00000100:00100000:0.0:1783969454.616039:0:9934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280595200 00000100:00100000:0.0:1783969454.616071:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783969454.616078:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3285:x1870627280595200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1783969454.616190:0:9934:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783969454.616194:0:9934:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1783969454 00002000:00010000:0.0:1783969454.616196:0:9934:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783969454.616198:0:9934:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1783969454 -> 1783969454 00002000:00010000:0.0:1783969454.616200:0:9934:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1783969454.616297:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3285:x1870627280595200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 219us (436us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1783969454.616304:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1783969454.616321:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783969454.616325:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1783969454.616351:0:3285:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ac7bff3aa00/2, rc 0, transno 4294967321 00000100:00100000:0.0:1783969454.616357:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280595200:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1783969454.616520:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ac7c1be9500/2, rc 0, transno 4294967310 00000100:00100000:2.0:1783969454.616526:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1be9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280594944:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783969454.616535:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783969454.616542:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280595072:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783969454.616571:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969454.616813:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+20:11586:x1870627272225280:12345-192.168.203.39@tcp:44:lhsmtool_posix.0 Request processed in 40640us (41199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969454.616822:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 227 00000100:00100000:0.0:1783969454.618997:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280595072 00000100:00100000:0.0:1783969454.619011:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280595072 00000100:00100000:0.0:1783969454.619073:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783969454.619082:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3287:x1870627280595072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1783969454.619125:0:6593:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1783969454.619149:0:6593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fabc7c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.619290:0:6593:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e40bea74/0xbacf56d076faba37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633e9 expref: 12 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.619299:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1783969454.619303:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783969454.619308:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fabc7c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.619344:0:6593:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e40bea74/0xbacf56d076faba37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633e9 expref: 12 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.619359:0:6593:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e40bea74/0xbacf56d076faba37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633e9 expref: 12 pid: 6593 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969454.619374:0:6593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff39c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6593:1870627280595328:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783969454.619448:0:6593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7c18e29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969454.623468:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969454.623569:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969454.623668:0:6593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff39c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6593:1870627280595328:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969454.623697:0:6593:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fabc7c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969454.623877:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272225536 00000100:00100000:3.0:1783969454.623884:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272225536 00010000:00010000:3.0:1783969454.623922:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e40bea74/0xbacf56d076faba37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633e9 expref: 13 pid: 6593 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969454.623960:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 85 00000100:00100000:3.0:1783969454.623969:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+13:2350:x1870627272225536:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969454.623983:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969454.623988:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e40bea74/0xbacf56d076faba37 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633e9 expref: 13 pid: 6593 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.624000:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e40bea74/0xbacf56d076faba37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633e9 expref: 13 pid: 6593 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.624022:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e40bea74/0xbacf56d076faba37 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633e9 expref: 13 pid: 6593 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.624037:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783969454.624041:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783969454.624061:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fabc7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.624071:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fabc7c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.624101:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969454.624281:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+12:2350:x1870627272225536:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 182us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969454.624290:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 85 00010000:00010000:2.0:1783969454.624353:0:6593:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fabc7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969454.624363:0:6593:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fabc7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969454.624373:0:6593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fabc7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969454.624382:0:6593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fabc7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969454.624405:0:6593:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783969454.624760:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969454.624766:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fabc7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.624775:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92e00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:3.0:1783969454.624779:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fabc7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.624788:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fabc7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.624801:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fabc7c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.624808:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fabc7c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.624837:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969454.624838:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969454.624840:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969454.626111:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786093100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3287:x1870627280595072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7025us (9534us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1783969454.626123:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783969454.626630:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272225408 00000100:00100000:2.0:1783969454.626695:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272225408 00000100:00100000:0.0:1783969454.626896:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 68 00000100:00100000:0.0:1783969454.626908:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+12:2349:x1870627272225408:12345-192.168.203.39@tcp:16:lhsmtool_posix.0 00000004:00080000:2.0:1783969454.628714:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ac7bff38700/2, rc 0, transno 4294967322 00000100:00100000:2.0:1783969454.628729:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280595072:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783969454.633650:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783969454.655079:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:0.0:1783969454.655096:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:0.0:1783969454.655103:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:0.0:1783969454.655122:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:3.0:1783969454.655435:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+7:2349:x1870627272225408:12345-192.168.203.39@tcp:16:lhsmtool_posix.0 Request processed in 28523us (31969us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969454.655446:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 68 00000100:00100000:1.0:1783969454.658367:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969454.658458:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272225792 00000100:00100000:3.0:1783969454.658467:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272225792 00000100:00100000:3.0:1783969454.658534:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 228 00000100:00100000:3.0:1783969454.658545:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+20:11586:x1870627272225792:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783969454.658599:0:10288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969454.658626:0:10288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f800/0xbacf56d076fabc60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6347c expref: 20 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.658806:0:10288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ac790086b00) 00010000:00010000:3.0:1783969454.658812:0:10288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783969454.658852:0:10288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabc83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.658906:0:10288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabc83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.658917:0:10288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabc83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783969454.659331:0:10288:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d5d53acc reply state 000000001e239b88 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabc83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969454.659358:0:10288:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783969454.659497:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+21:11586:x1870627272225792:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 952us (1137us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1783969454.659505:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 228 00000100:00100000:1.0:1783969454.662533:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969454.662615:0:9934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272225920 00000100:00100000:0.0:1783969454.662623:0:9934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272225920 00000100:00100000:0.0:1783969454.662946:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 69 00000100:00100000:0.0:1783969454.662957:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+7:2350:x1870627272225920:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783969454.663203:0:9934:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1783969454.663207:0:9934:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1783969454 -> 1783969453 00002000:00010000:0.0:1783969454.663210:0:9934:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1783969453 00002000:00010000:0.0:1783969454.663286:0:9934:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1783969454 -> 1783969453 00002000:00010000:0.0:1783969454.663289:0:9934:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1783969454.663342:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+8:2350:x1870627272225920:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 Request processed in 387us (817us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1783969454.663350:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 69 00010000:00010000:3.0:1783969454.664114:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabc83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.664126:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabc83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.664135:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabc83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.664141:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969454.664145:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabc83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.664162:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabc83 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.664177:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ac790086b00) 00010000:00010000:3.0:1783969454.664180:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969454.664184:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabc83 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.664190:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabc83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969454.665442:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969454.665525:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272226176 00000100:00100000:1.0:1783969454.665533:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272226176 00000100:00100000:1.0:1783969454.665588:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 229 00000100:00100000:1.0:1783969454.665598:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+20:11586:x1870627272226176:12345-192.168.203.39@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1783969454.665717:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e600/0xbacf56d076fabc8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.665733:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fabc44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6346e expref: 20 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.665741:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e600/0xbacf56d076fabc8a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.665771:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fabc44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6346e expref: 20 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.665784:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fabc44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6346e expref: 20 pid: 5793 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969454.665796:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1870627280595456:192.168.203.39@tcp:104: 00000100:00100000:1.0:1783969454.665970:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa45300 going to sleep for 11 seconds 00000100:00100000:0.0:1783969454.668240:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1870627280595456:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783969454.668265:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e600/0xbacf56d076fabc8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969454.668319:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969454.668406:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272226304 00000100:00100000:2.0:1783969454.668412:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272226304 00010000:00010000:2.0:1783969454.668439:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fabc44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6346e expref: 21 pid: 5793 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969454.668490:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 86 00000100:00100000:2.0:1783969454.668496:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03985e57-ffb4-414b-b30c-e72697857d4f+21:2350:x1870627272226304:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969454.668506:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969454.668511:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fabc44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6346e expref: 21 pid: 5793 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969454.668519:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fabc44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6346e expref: 21 pid: 5793 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969454.668536:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93e00/0xbacf56d076fabc44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6346e expref: 21 pid: 5793 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969454.668546:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ac790086b00) 00010000:00010000:2.0:1783969454.668550:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e600/0xbacf56d076fabc8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969454.668556:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e600/0xbacf56d076fabc8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969454.668575:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e600/0xbacf56d076fabc8a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969454.668594:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969454.668643:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03985e57-ffb4-414b-b30c-e72697857d4f+20:2350:x1870627272226304:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 145us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969454.668650:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 86 00010000:00010000:0.0:1783969454.668897:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e600/0xbacf56d076fabc8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.668904:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e600/0xbacf56d076fabc8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.668933:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e600/0xbacf56d076fabc8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.668940:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e600/0xbacf56d076fabc8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.668958:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e600/0xbacf56d076fabc8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.668964:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60e600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969454.668968:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e600/0xbacf56d076fabc8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.668975:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e600/0xbacf56d076fabc8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.668989:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ac790086b00) 00010000:00010000:0.0:1783969454.668992:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1783969454.668995:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e600/0xbacf56d076fabc8a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.669001:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e600/0xbacf56d076fabc8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969454.669062:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+19:11586:x1870627272226176:12345-192.168.203.39@tcp:55:lhsmtool_posix.0 Request processed in 3465us (3630us total) trans 0 rc -22/-22 00000100:00100000:0.0:1783969454.669070:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 229 00000100:00100000:1.0:1783969454.671003:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969454.671292:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272226432 00000100:00100000:0.0:1783969454.671301:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272226432 00000100:00100000:0.0:1783969454.671388:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 70 00000100:00100000:0.0:1783969454.671398:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+8:2348:x1870627272226432:12345-192.168.203.39@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1783969454.671456:0:6595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabc91 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.671480:0:6595:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c466b656/0xbacf56d076fabc6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6348a expref: 8 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.671503:0:6595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969454.671507:0:6595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783969454.671513:0:6595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabc91 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.671548:0:6595:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c466b656/0xbacf56d076fabc6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6348a expref: 8 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.671562:0:6595:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c466b656/0xbacf56d076fabc6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6348a expref: 8 pid: 6595 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969454.671575:0:6595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6595:1870627280595584:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783969454.671649:0:6595:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7c18e2780 going to sleep for 11 seconds 00000100:00100000:0.0:1783969454.674777:0:6595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6595:1870627280595584:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783969454.674807:0:6595:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabc91 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969454.676938:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969454.676997:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272226560 00000100:00100000:3.0:1783969454.677014:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272226560 00010000:00010000:3.0:1783969454.677054:0:5778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c466b656/0xbacf56d076fabc6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6348a expref: 9 pid: 6595 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969454.677097:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 87 00000100:00100000:3.0:1783969454.677107:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+9:2351:x1870627272226560:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969454.677121:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969454.677144:0:5778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c466b656/0xbacf56d076fabc6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6348a expref: 9 pid: 6595 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.677169:0:5778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c466b656/0xbacf56d076fabc6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6348a expref: 9 pid: 6595 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.677192:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c466b656/0xbacf56d076fabc6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6348a expref: 9 pid: 6595 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.677207:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783969454.677422:0:5778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783969454.677431:0:5778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabc91 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.677441:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabc91 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.677514:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969454.677567:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03985e57-ffb4-414b-b30c-e72697857d4f+8:2351:x1870627272226560:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 461us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969454.677584:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 87 00010000:00010000:0.0:1783969454.679015:0:6595:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabc91 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.679032:0:6595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabc91 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.679062:0:6595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabc91 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.679083:0:6595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabc91 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.679092:0:6595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabc91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.679099:0:6595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93000 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969454.679103:0:6595:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabc91 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.679112:0:6595:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabc91 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.679129:0:6595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabc91 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.679137:0:6595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabc91 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969454.679238:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+7:2348:x1870627272226432:12345-192.168.203.39@tcp:1:lhsmtool_posix.0 Request processed in 7837us (8238us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969454.679247:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 70 00000100:00100000:1.0:1783969454.690597:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969454.690702:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272226816 00000100:00100000:3.0:1783969454.690712:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272226816 00000100:00100000:3.0:1783969454.690770:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 230 00000100:00100000:3.0:1783969454.690780:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+19:11586:x1870627272226816:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783969454.690882:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabc98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.690899:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabc98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.690910:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabc98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.691098:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fabc9f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.691109:0:6618:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabc52 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63475 expref: 20 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.691117:0:6618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fabc9f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.691161:0:6618:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabc52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63475 expref: 20 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969454.691176:0:6618:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabc52 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63475 expref: 20 pid: 5794 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969454.691210:0:6618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbe300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6618:1870627280595712:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783969454.691296:0:6618:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b5224180 going to sleep for 11 seconds 00000100:00100000:3.0:1783969454.694324:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969454.694450:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272226944 00000100:00100000:2.0:1783969454.694458:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272226944 00010000:00010000:2.0:1783969454.694492:0:5779:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabc52 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63475 expref: 21 pid: 5794 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969454.694527:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 88 00000100:00100000:2.0:1783969454.694535:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7860be050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+21:2351:x1870627272226944:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969454.694549:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969454.694554:0:5779:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabc52 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63475 expref: 21 pid: 5794 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969454.694568:0:5779:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabc52 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63475 expref: 21 pid: 5794 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969454.694587:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ac790086b00) 00010000:00010000:2.0:1783969454.694592:0:5779:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fabc9f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969454.694601:0:5779:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fabc9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969454.694631:0:5779:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fabc9f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969454.694655:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969454.694696:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7860be050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+21:2351:x1870627272226944:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 161us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969454.694704:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 88 00010000:00010000:1.0:1783969454.695543:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fabc52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63475 expref: 20 pid: 5794 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969454.695560:0:6618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbe300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6618:1870627280595712:192.168.203.39@tcp:104: 00010000:00010000:1.0:1783969454.695581:0:6618:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fabc9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.695590:0:6618:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fabc9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.695595:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fabc9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783969454.695779:0:6618:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1783969454.695960:0:6618:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1783969454.696004:0:6618:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1783969454.696083:0:6618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6618:1870627280595840:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1783969454.696132:0:6618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969454.696162:0:6618:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa45480 going to sleep for 11 seconds 00000100:00100000:3.0:1783969454.696413:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280595840 00000100:00100000:3.0:1783969454.696420:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280595840 00000100:00100000:3.0:1783969454.696466:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783969454.696475:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6618:x1870627280595840:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1783969454.696546:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6618:x1870627280595840:12345-0@lo:1000:mdt00_003.0 Request processed in 73us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969454.696553:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783969454.697185:0:6618:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1783969454.697192:0:6618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ac7bff35500, transno 4294967315 00000004:00080000:1.0:1783969454.697351:0:6618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:1.0:1783969454.697372:0:6618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ac7bff3aa00, transno 4294967321 00000004:00080000:1.0:1783969454.697375:0:6618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ac7bff38700, transno 4294967322 00000100:00100000:1.0:1783969454.697382:0:6618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6618:1870627280595840:0@lo:1000:mdt00_003.0 00000004:00080000:3.0:1783969454.698460:0:6642:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000001:00080000:1.0:1783969454.699088:0:6618:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1783969454.699325:0:6618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6618:1870627280595968:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1783969454.699390:0:6618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969454.699437:0:6618:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa459c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969454.699492:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280595968 00000100:00100000:3.0:1783969454.699499:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280595968 00000100:00100000:3.0:1783969454.699549:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783969454.699558:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6618:x1870627280595968:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1783969454.700123:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6618:x1870627280595968:12345-0@lo:1000:mdt00_003.0 Request processed in 565us (731us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1783969454.700131:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783969454.700356:0:6618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6618:1870627280595968:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1783969454.700388:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fabc9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.700398:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fabc9f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.700405:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fabc9f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.700412:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de7800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969454.700416:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fabc9f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.700423:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fabc9f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.700437:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ac790086b00) 00010000:00010000:1.0:1783969454.700440:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783969454.700444:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fabc9f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.700451:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fabc9f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.700479:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fabbe2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.700486:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fabbe2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.700491:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fabbe2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.700506:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60ee00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969454.700509:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fabbe2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.700514:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fabbe2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.700523:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:1.0:1783969454.700526:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783969454.700533:0:6618:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabbe9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63459 expref: 23 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.700543:0:6618:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabbe9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63459 expref: 23 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.700551:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabbe9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63459 expref: 23 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.700579:0:6618:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabbe9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63459 expref: 23 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969454.700591:0:6618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6618:1870627280596096:192.168.203.39@tcp:105: 00000100:00100000:1.0:1783969454.700824:0:6618:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfa459c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969454.704491:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969454.704572:0:6618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6618:1870627280596096:192.168.203.39@tcp:105: 00010000:00010000:1.0:1783969454.704595:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fabbe2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.704630:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ee00/0xbacf56d076fabbe2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.704665:0:6618:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076fabca6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.704679:0:6618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076fabca6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.704691:0:6618:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076fabca6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.704701:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076fabca6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.704707:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076fabca6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.704714:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076fabca6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.704719:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60e400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969454.704723:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076fabca6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.704730:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076fabca6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.704739:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:1.0:1783969454.704742:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969454.704745:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076fabca6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.704755:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e400/0xbacf56d076fabca6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.704764:0:6618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabc98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.704769:0:6618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabc98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.704775:0:6618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabc98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.704781:0:6618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969454.704783:0:6618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabc98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.704789:0:6618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabc98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.704796:0:6618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:1.0:1783969454.704798:0:6618:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783969454.704800:0:6618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabc98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.704806:0:6618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fabc98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6618 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969454.705041:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+23:11586:x1870627272226816:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 14261us (14451us total) trans 4294967513 rc 0/0 00000100:00100000:1.0:1783969454.705050:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 230 00000020:00080000:1.0:1783969454.705060:0:6618:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1783969454.705239:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783969454.705243:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783969454.705922:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1783969454.705936:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783969454.706357:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272227072 00000100:00100000:2.0:1783969454.706365:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272227072 00000100:00100000:2.0:1783969454.706415:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 61 00000100:00100000:2.0:1783969454.706424:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+23:11585:x1870627272227072:12345-192.168.203.39@tcp:49:lfs.0 00000100:00100000:2.0:1783969454.706527:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+23:11585:x1870627272227072:12345-192.168.203.39@tcp:49:lfs.0 Request processed in 104us (2044us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969454.706534:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 61 00000100:00100000:2.0:1783969454.710903:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969454.710947:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969454.711061:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272227328 00000100:00100000:3.0:1783969454.711071:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272227328 00000100:00100000:3.0:1783969454.711127:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 231 00000100:00100000:3.0:1783969454.711138:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+23:11585:x1870627272227328:12345-192.168.203.39@tcp:58:lfs.0 00000040:00080000:3.0:1783969454.711511:0:10288:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1783969454.711605:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+23:11585:x1870627272227328:12345-192.168.203.39@tcp:58:lfs.0 Request processed in 468us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969454.711613:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 231 00000100:00100000:1.0:1783969454.712059:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272227584 00000100:00100000:1.0:1783969454.712065:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272227584 00000100:00100000:1.0:1783969454.712093:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 62 00000100:00100000:1.0:1783969454.712100:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7861eac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+23:11586:x1870627272227584:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783969454.712620:0:5796:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783969454.712711:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:1.0:1783969454.712753:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fabcad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.712768:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fabcad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.712779:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fabcad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.712787:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fabcad lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.712794:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fabcad lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.712800:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fabcad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.712827:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783969454.712926:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7861eac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+25:11586:x1870627272227584:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 825us (1977us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1783969454.712934:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 62 00000020:00080000:1.0:1783969454.712938:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783969454.713153:0:8303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969454.713161:0:8303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fabcad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.713168:0:8303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60e200 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969454.713173:0:8303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fabcad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.713180:0:8303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fabcad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.713191:0:8303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9ac7829e0d00) 00010000:00010000:0.0:1783969454.713194:0:8303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783969454.713198:0:8303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fabcad lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.713204:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e200/0xbacf56d076fabcad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.713231:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969454.713233:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969454.713235:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969454.745130:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969454.745401:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272227712 00000100:00100000:0.0:1783969454.745410:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272227712 00000100:00100000:0.0:1783969454.745503:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 232 00000100:00100000:0.0:1783969454.745513:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+25:11588:x1870627272227712:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783969454.745536:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969454.745557:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fabcb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63491 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.745658:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabcbb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.745672:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabcbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.745684:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabcbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.745699:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabcc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.745856:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabcc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.745909:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabcc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.746413:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabcc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.746427:0:5793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabbd4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63452 expref: 26 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.746436:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabcc9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.746470:0:5793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabbd4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63452 expref: 26 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.746498:0:5793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabbd4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63452 expref: 26 pid: 5795 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969454.746512:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1870627280596224:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783969454.746650:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7c18e2780 going to sleep for 11 seconds 00000100:00100000:3.0:1783969454.750972:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969454.751068:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff38a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5793:1870627280596224:192.168.203.39@tcp:104: 00010000:00010000:1.0:1783969454.751108:0:5793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabcc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969454.751655:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272227968 00000100:00100000:2.0:1783969454.751664:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272227968 00000100:00100000:2.0:1783969454.751725:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 63 00000100:00100000:2.0:1783969454.751734:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+27:5578:x1870627272227968:12345-192.168.203.39@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783969454.752475:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+28:5578:x1870627272227968:12345-192.168.203.39@tcp:35:ldlm_bl.0 Request processed in 738us (1508us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1783969454.752484:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 63 00000100:00100000:3.0:1783969454.754576:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969454.754961:0:8304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272228096 00000100:00100000:0.0:1783969454.754969:0:8304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272228096 00010000:00010000:0.0:1783969454.755008:0:8304:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabbd4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63452 expref: 28 pid: 5795 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969454.755075:0:8304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 89 00000100:00100000:0.0:1783969454.755085:0:8304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+28:2350:x1870627272228096:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969454.755100:0:8304:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969454.755106:0:8304:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabbd4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63452 expref: 28 pid: 5795 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.755120:0:8304:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabbd4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63452 expref: 28 pid: 5795 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.755142:0:8304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fabbd4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63452 expref: 28 pid: 5795 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.755168:0:8304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:0.0:1783969454.755173:0:8304:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabcc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.755199:0:8304:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabcc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.755207:0:8304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabcc9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969454.755246:0:8304:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969454.755338:0:8304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03985e57-ffb4-414b-b30c-e72697857d4f+27:2350:x1870627272228096:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 254us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969454.755346:0:8304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 89 00010000:00010000:1.0:1783969454.755396:0:5793:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabcc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.755404:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabcc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969454.755440:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1783969454.755444:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783969454.755461:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabcc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.755472:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabcc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.755481:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabcbb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.755489:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabcbb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.755495:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabcbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.755501:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969454.755505:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabcbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.755512:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabcbb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.755531:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:1.0:1783969454.755533:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969454.755537:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabcbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.755544:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92600/0xbacf56d076fabcbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.755553:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabcc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.755559:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabcc2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.755564:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabcc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.755569:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969454.755572:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabcc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.755578:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabcc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.755585:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ac790086800) 00010000:00010000:1.0:1783969454.755587:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969454.755590:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabcc2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.755596:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92400/0xbacf56d076fabcc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.755656:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92e00/0xbacf56d076fabcb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63491 expref: 27 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.755668:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabcc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63491 expref: 26 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969454.755676:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:1.0:1783969454.755678:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783969454.755680:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93c00, rc 0) 00000100:00100000:1.0:1783969454.755703:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+26:11588:x1870627272227712:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 10193us (10583us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969454.755718:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 232 00000001:00080000:2.0:1783969455.273750:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1783969455.273771:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000040:00080000:1.0:1783969455.624973:0:12358:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783969455.624982:0:12358:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783969455.626522:0:12358:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1783969455.626531:0:12358:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1783969455.652956:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783969455.719109:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783969455.719118:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783969455.719188:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1783969455.719195:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783969455.720618:0:11535:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbf800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1870627280596352:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783969455.720973:0:11535:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b52243c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969455.734633:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969455.734853:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272228224 00000100:00100000:1.0:1783969455.734883:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272228224 00000100:00100000:1.0:1783969455.734945:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 233 00000100:00100000:1.0:1783969455.734956:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+27:11600:x1870627272228224:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783969455.734989:0:6618:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00080000:0.0:1783969455.734999:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969455.735123:0:11535:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbf800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11535:1870627280596352:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783969455.735138:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03985e57-ffb4-414b-b30c-e72697857d4f+27:11600:x1870627272228224:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 Request processed in 181us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969455.735147:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 233 00000100:00100000:1.0:1783969455.749718:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969455.749856:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272228480 00000100:00100000:3.0:1783969455.749888:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272228480 00000100:00100000:3.0:1783969455.749948:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 234 00000100:00100000:3.0:1783969455.749959:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+26:11600:x1870627272228480:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969455.749978:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969455.749999:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fabcd0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63498 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969455.750128:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fabcd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969455.750153:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fabcd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969455.750165:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fabcd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969455.750194:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1783969455.750525:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7a00/0xbacf56d076fabcd0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63498 expref: 29 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969455.750550:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fabcd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63498 expref: 28 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969455.750559:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:3.0:1783969455.750562:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783969455.750566:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7400, rc 0) 00000100:00100000:3.0:1783969455.750633:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+28:11600:x1870627272228480:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 674us (924us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1783969455.750640:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 234 00000100:00100000:2.0:1783969455.769463:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969455.769561:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272228608 00000100:00100000:3.0:1783969455.769571:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272228608 00000100:00100000:3.0:1783969455.769750:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:3.0:1783969455.771723:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786091180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+28:2351:x1870627272228608:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969455.771749:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969455.771777:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fabcd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63498 expref: 28 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969455.771796:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:3.0:1783969455.771801:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969455.772458:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786091180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03985e57-ffb4-414b-b30c-e72697857d4f+27:2351:x1870627272228608:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 2696us (3001us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969455.772470:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:3.0:1783969455.775126:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969455.775311:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272228864 00000100:00100000:2.0:1783969455.775320:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272228864 00000100:00100000:2.0:1783969455.775380:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 235 00000100:00100000:2.0:1783969455.775391:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+27:11600:x1870627272228864:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783969455.775465:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098200/0xbacf56d076fabce5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.775481:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098200/0xbacf56d076fabce5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.775491:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098200/0xbacf56d076fabce5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.776049:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098200/0xbacf56d076fabce5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.776059:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098200/0xbacf56d076fabce5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.776066:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098200/0xbacf56d076fabce5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.776072:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786098200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969455.776076:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098200/0xbacf56d076fabce5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.776084:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098200/0xbacf56d076fabce5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.776097:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:2.0:1783969455.776100:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783969455.776119:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098200/0xbacf56d076fabce5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969455.776125:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098200/0xbacf56d076fabce5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969455.776274:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+28:11600:x1870627272228864:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 883us (1157us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1783969455.776283:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 235 00000040:00080000:0.0:1783969455.776394:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783969455.776399:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783969455.776920:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1783969455.776928:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783969455.784828:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969455.784898:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272229120 00000100:00100000:3.0:1783969455.784907:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272229120 00000100:00100000:3.0:1783969455.784973:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 64 00000100:00100000:3.0:1783969455.784984:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+28:11600:x1870627272229120:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783969455.785191:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+29:11600:x1870627272229120:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 208us (371us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1783969455.785198:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 64 00010000:00010000:2.0:1783969456.677350:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969456.745655:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac786090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280596480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783969456.745727:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969456.745889:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280596480 00000100:00100000:2.0:1783969456.745897:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280596480 00000100:00100000:2.0:1783969456.745974:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783969456.745985:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1870627280596480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969456.746029:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783969456.746082:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1870627280596480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969456.746088:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783969456.746536:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac786090a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280596480:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783969456.746609:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969457.255557:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac786091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280596864:0@lo:400:kworker.0 00000100:00100000:2.0:1783969457.255633:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969457.255690:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783969457.255699:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac786090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280596992:0@lo:400:kworker.0 00000100:00100000:2.0:1783969457.255730:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969457.255771:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280596864 00000100:00100000:2.0:1783969457.255778:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280596864 00000100:00100000:1.0:1783969457.255926:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac786093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280596608:0@lo:400:kworker.0 00000100:00100000:1.0:1783969457.255965:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969457.255995:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac786091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1870627280597120:0@lo:400:kworker.0 00000100:00100000:1.0:1783969457.256020:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969457.256943:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783969457.256954:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac786091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280596736:0@lo:400:kworker.0 00000100:00100000:1.0:1783969457.256992:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969457.259131:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280597120 00000100:00100000:2.0:1783969457.259159:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280597120 00000100:00100000:2.0:1783969457.259236:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783969457.259247:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280596864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969457.259340:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280596864:12345-0@lo:400:kworker.0 Request processed in 95us (3706us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969457.259347:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1783969457.259367:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783969457.259374:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1870627280597120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969457.259404:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1870627280597120:12345-0@lo:400:kworker.0 Request processed in 31us (3383us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969457.259409:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783969457.259431:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280596992 00000100:00100000:2.0:1783969457.259434:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280596992 00000100:00100000:2.0:1783969457.259462:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783969457.259469:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1870627280596992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969457.259500:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1870627280596992:12345-0@lo:400:kworker.0 Request processed in 32us (3769us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969457.259506:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1783969457.259520:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969457.259532:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280596608 00000100:00100000:2.0:1783969457.259536:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280596608 00000100:00100000:2.0:1783969457.259559:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1783969457.259565:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3287:x1870627280596608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969457.259595:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3287:x1870627280596608:12345-0@lo:400:kworker.0 Request processed in 31us (3630us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969457.259601:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1783969457.259663:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac786090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280596992:0@lo:400:kworker.0 00000100:00100000:2.0:1783969457.259675:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac786091f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280596864:0@lo:400:kworker.0 00000100:00100000:1.0:1783969457.272319:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac786091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280597248:0@lo:400:kworker.0 00000100:00100000:1.0:1783969457.272380:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969457.272417:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac786093800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280596608:0@lo:400:kworker.0 00000100:00100000:1.0:1783969457.272433:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac786091880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1870627280597120:0@lo:400:kworker.0 00000100:00100000:1.0:1783969457.272476:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280596736 00000100:00100000:1.0:1783969457.272482:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280596736 00000100:00100000:1.0:1783969457.272531:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783969457.272540:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280596736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969457.272592:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280596736:12345-0@lo:400:kworker.0 Request processed in 52us (15599us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969457.272600:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1783969457.272621:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280597248 00000100:00100000:1.0:1783969457.272625:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280597248 00000100:00100000:1.0:1783969457.272657:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783969457.272664:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280597248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969457.272693:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280597248:12345-0@lo:400:kworker.0 Request processed in 29us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969457.272699:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1783969457.272726:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969457.272745:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac786091500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280596736:0@lo:400:kworker.0 00000100:00100000:1.0:1783969457.272753:0:3287:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1783969457.272757:0:3287:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ac7bff35f80, transno 4294967307 00000004:00080000:1.0:1783969457.272767:0:3287:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1783969457.272781:0:3287:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ac7c1be9500, transno 4294967310 00000100:00100000:1.0:1783969457.272785:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac786091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280597248:0@lo:400:kworker.0 00000040:00080000:2.0:1783969457.677508:0:12409:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783969457.677518:0:12409:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783969457.677586:0:12409:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1783969457.677593:0:12409:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1783969457.703093:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969457.767972:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280597376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969457.768043:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969457.768114:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280597376 00000100:00100000:0.0:1783969457.768122:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280597376 00000100:00100000:0.0:1783969457.768164:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783969457.768172:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280597376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783969457.768203:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783969457.768245:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280597376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969457.768260:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783969457.768302:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280597376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783969457.831121:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969457.831176:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272229376 00000100:00100000:3.0:1783969457.831186:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272229376 00000100:00100000:3.0:1783969457.831271:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 236 00000100:00100000:3.0:1783969457.831282:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+29:11620:x1870627272229376:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783969457.831305:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1783969457.831469:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783969457.832106:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fabcec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6349f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969457.832206:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fabcf3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969457.832219:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fabcf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969457.832231:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fabcf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969457.832240:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1783969457.832361:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7400/0xbacf56d076fabcec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6349f expref: 32 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969457.832392:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fabcf3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6349f expref: 31 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969457.832400:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:3.0:1783969457.832403:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783969457.832407:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de6a00, rc 0) 00000100:00100000:3.0:1783969457.832473:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786091f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+31:11620:x1870627272229376:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1193us (1625us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1783969457.832490:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 236 00000100:00100000:3.0:1783969457.842682:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969457.842953:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272229504 00000100:00100000:1.0:1783969457.842963:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272229504 00000100:00100000:1.0:1783969457.843174:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 237 00000100:00100000:1.0:1783969457.843189:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+31:11620:x1870627272229504:12345-192.168.203.39@tcp:54:lfs.0 00010000:00010000:1.0:1783969457.843256:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fabd01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969457.843397:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fabd01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969457.843412:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fabd01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969457.843437:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fabd01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969457.843444:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fabd01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969457.843451:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fabd01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969457.843458:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60f400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969457.843470:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fabd01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969457.843478:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fabd01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969457.843490:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:1.0:1783969457.843493:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783969457.843497:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fabd01 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969457.843504:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f400/0xbacf56d076fabd01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969457.843969:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03985e57-ffb4-414b-b30c-e72697857d4f+31:11620:x1870627272229504:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 390us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969457.843979:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 237 00000100:00100000:3.0:1783969457.953102:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969457.953310:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272229632 00000100:00100000:2.0:1783969457.953320:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272229632 00000100:00100000:2.0:1783969457.953399:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 71 00000100:00100000:2.0:1783969457.953410:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+7:2349:x1870627272229632:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:2.0:1783969457.953437:0:6593:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969457.953456:0:6593:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b308c124/0xbacf56d076fabd08 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb634a6 expref: -99 pid: 6593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783969457.953492:0:6593:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a5536ad, atime: 0x6a5536ad, ctime: 0x6a5536ad, blocks: 0xb 00010000:00010000:2.0:1783969457.953513:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=315s v=(0 0) 00010000:00010000:2.0:1783969457.953518:0:6593:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969457.953527:0:6593:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b308c124/0xbacf56d076fabd08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb634a6 expref: 8 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969457.953544:0:6593:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b308c124/0xbacf56d076fabd08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb634a6 expref: 8 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969457.953557:0:6593:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786098000, rc 0) 00000100:00080000:1.0:1783969457.953769:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969457.954288:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+8:2349:x1870627272229632:12345-192.168.203.39@tcp:101:cat.0 Request processed in 876us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969457.954765:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 71 00000100:00100000:0.0:1783969457.961965:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969457.962164:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272229760 00000100:00100000:3.0:1783969457.962173:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272229760 00002000:00100000:3.0:1783969457.962222:0:6599:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9ac7bff38a80 x1870627272229760/t0(0) o3->03985e57-ffb4-414b-b30c-e72697857d4f@192.168.203.39@tcp:353/0 lens 488/0 e 0 to 0 dl 1783969468 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783969457.962233:0:6599:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac7bff38a80 with x1870627272229760 ext(0->4095) 00002000:00010000:3.0:1783969457.962237:0:6599:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ac7bff38a80 00000100:00100000:3.0:1783969457.962269:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:3.0:1783969457.962278:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:03985e57-ffb4-414b-b30c-e72697857d4f+8:2348:x1870627272229760:12345-192.168.203.39@tcp:3:cat.0 00000100:00100000:3.0:1783969457.962469:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:03985e57-ffb4-414b-b30c-e72697857d4f+8:2348:x1870627272229760:12345-192.168.203.39@tcp:3:cat.0 Request processed in 191us (514us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1783969457.962477:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 7 00002000:00100000:3.0:1783969457.962483:0:6599:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9ac7bff38a80 x1870627272229760/t0(0) o3->03985e57-ffb4-414b-b30c-e72697857d4f@192.168.203.39@tcp:353/0 lens 488/4536 e 0 to 0 dl 1783969468 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783969457.962510:0:6599:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9ac7bff38a80 with x1870627272229760 ext(0->4095) 00002000:00010000:3.0:1783969457.962514:0:6599:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ac7bff38a80 00010000:00010000:3.0:1783969458.725284:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969458.750279:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969458.750327:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969458.750368:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969458.750399:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969458.750422:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969458.750689:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272230400 00000100:00100000:2.0:1783969458.750698:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272230400 00000100:00100000:2.0:1783969458.750761:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272230016 00000100:00100000:2.0:1783969458.750765:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272230016 00000100:00100000:2.0:1783969458.750790:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 149 00000100:00100000:2.0:1783969458.750799:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2348:x1870627272230400:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783969458.750920:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2348:x1870627272230400:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 121us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969458.750927:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 149 00000100:00100000:2.0:1783969458.750947:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 150 00000100:00100000:2.0:1783969458.750954:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+31:2348:x1870627272230016:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783969458.750981:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+31:2348:x1870627272230016:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 28us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969458.750988:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 150 00000100:00100000:1.0:1783969458.751065:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272229888 00000100:00100000:1.0:1783969458.751069:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272229888 00000100:00100000:1.0:1783969458.751106:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 293 00000100:00100000:1.0:1783969458.751114:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2348:x1870627272229888:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969458.751153:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2348:x1870627272229888:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 40us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969458.751160:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 293 00000100:00100000:0.0:1783969458.751329:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272230144 00000100:00100000:0.0:1783969458.751335:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272230144 00000100:00100000:0.0:1783969458.751368:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272230272 00000100:00100000:0.0:1783969458.751372:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272230272 00000100:00100000:0.0:1783969458.751404:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 73 00000100:00100000:0.0:1783969458.751411:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+8:2348:x1870627272230144:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969458.751440:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+8:2348:x1870627272230144:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 30us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969458.751447:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 73 00000100:00100000:0.0:1783969458.751460:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 74 00000100:00100000:0.0:1783969458.751466:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+5:2348:x1870627272230272:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969458.751489:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03985e57-ffb4-414b-b30c-e72697857d4f+5:2348:x1870627272230272:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969458.751494:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 74 00000100:00080000:3.0:1783969458.752733:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783969458.752742:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783969459.750076:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783969459.888970:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:2.0:1783969459.888986:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1783969459.889917:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967515 is committed 00000020:00080000:2.0:1783969459.889933:0:5816:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ac7bfa45480 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1783969459.889937:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ac788286800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ac7bfa45d80 00000020:00080000:2.0:1783969459.889941:0:5816:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9ac788286000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ac7bf550400 00000001:00080000:2.0:1783969459.889970:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:2.0:1783969459.889978:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:2.0:1783969459.889987:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1783969459.890073:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1783969459.890274:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1783969460.774281:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969461.797672:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969461.861165:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac786090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280597504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969461.861234:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969461.861352:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280597504 00000100:00100000:2.0:1783969461.861359:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280597504 00000100:00100000:2.0:1783969461.861406:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783969461.861416:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280597504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969461.861452:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783969461.861504:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280597504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969461.861511:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783969461.861633:0:3286:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000100:00080000:3.0:1783969461.861640:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1783969461.861641:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1783969461.861680:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac786090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280597504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783969462.375683:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac786090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870627280597760:0@lo:400:kworker.0 00000100:00100000:2.0:1783969462.375750:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969462.375812:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac786091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280598272:0@lo:400:kworker.0 00000100:00100000:2.0:1783969462.375838:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969462.375880:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783969462.375886:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac786092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280597632:0@lo:400:kworker.0 00000100:00100000:2.0:1783969462.375913:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969462.375934:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac786090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1870627280598144:0@lo:400:kworker.0 00000100:00100000:2.0:1783969462.375955:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969462.375977:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac786092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280597888:0@lo:400:kworker.0 00000100:00100000:2.0:1783969462.375996:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969462.376012:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783969462.376017:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac786093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280598016:0@lo:400:kworker.0 00000100:00100000:2.0:1783969462.376039:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969462.376073:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280597760 00000100:00100000:2.0:1783969462.376079:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280597760 00000100:00100000:2.0:1783969462.376117:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280598144 00000100:00100000:2.0:1783969462.376127:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280598144 00000100:00100000:2.0:1783969462.376157:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280597888 00000100:00100000:2.0:1783969462.376159:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280597888 00000100:00100000:2.0:1783969462.376174:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783969462.376182:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870627280597760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969462.376230:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870627280597760:12345-0@lo:400:kworker.0 Request processed in 48us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969462.376237:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783969462.376253:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783969462.376260:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870627280598144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969462.376286:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786093800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870627280598144:12345-0@lo:400:kworker.0 Request processed in 27us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969462.376292:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783969462.376303:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1783969462.376309:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280597888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969462.376337:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280597888:12345-0@lo:400:kworker.0 Request processed in 28us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969462.376343:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1783969462.376361:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280598272 00000100:00100000:2.0:1783969462.376364:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280598272 00000100:00100000:2.0:1783969462.376386:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280598016 00000100:00100000:2.0:1783969462.376389:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280598016 00000100:00100000:1.0:1783969462.376644:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783969462.376654:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280598272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969462.376690:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280598272:12345-0@lo:400:kworker.0 Request processed in 38us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969462.376696:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783969462.376708:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783969462.376713:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7ba26b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280598016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969462.376737:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7ba26b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280598016:12345-0@lo:400:kworker.0 Request processed in 24us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969462.376743:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1783969462.376907:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783969462.376912:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969462.376930:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280597632 00000100:00100000:1.0:1783969462.376933:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280597632 00000100:00100000:1.0:1783969462.376959:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1783969462.376964:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:3288:x1870627280597632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969462.376993:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c893ad09-f78f-4711-bea5-6489668294ed+19:3288:x1870627280597632:12345-0@lo:400:kworker.0 Request processed in 28us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969462.376999:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1783969462.377691:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac786092300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280597632:0@lo:400:kworker.0 00000100:00100000:2.0:1783969462.377705:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac786090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1870627280598144:0@lo:400:kworker.0 00000100:00100000:2.0:1783969462.377715:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac786090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870627280597760:0@lo:400:kworker.0 00000100:00100000:2.0:1783969462.377723:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac786091c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280598272:0@lo:400:kworker.0 00000100:00100000:2.0:1783969462.377768:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac786093b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280598016:0@lo:400:kworker.0 00000100:00100000:2.0:1783969462.377778:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac786092a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280597888:0@lo:400:kworker.0 00010000:00010000:1.0:1783969462.825511:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969462.887128:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783969462.887149:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280598400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969462.887212:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969462.887267:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280598400 00000100:00100000:0.0:1783969462.887273:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280598400 00000100:00100000:0.0:1783969462.887316:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783969462.887325:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1598450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280598400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783969462.887355:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783969462.887404:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1598450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280598400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969462.887412:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783969462.887766:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280598400:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1783969462.954773:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783969462.954784:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783969462.954836:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1783969462.954843:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783969463.074029:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969463.074131:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272230528 00000100:00100000:2.0:1783969463.074140:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272230528 00000100:00100000:2.0:1783969463.074222:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 238 00000100:00100000:2.0:1783969463.074233:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+18:11274:x1870627272230528:12345-192.168.203.39@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1783969463.074331:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+18:11274:x1870627272230528:12345-192.168.203.39@tcp:60:lhsmtool_posix.0 Request processed in 100us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969463.074339:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 238 00000100:00080000:1.0:1783969463.074438:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969463.077632:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969463.077750:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272230784 00000100:00100000:1.0:1783969463.077759:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272230784 00000100:00100000:1.0:1783969463.077825:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 65 00000100:00100000:1.0:1783969463.077835:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+18:11274:x1870627272230784:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783969463.078364:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+19:11274:x1870627272230784:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 527us (739us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1783969463.078373:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 65 00000100:00100000:3.0:1783969463.435135:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969463.436043:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272230912 00000100:00100000:1.0:1783969463.436053:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272230912 00000100:00100000:1.0:1783969463.436137:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 239 00000100:00100000:1.0:1783969463.436147:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:12071:x1870627272230912:12345-192.168.203.39@tcp:101:lsof.0 00010000:00010000:1.0:1783969463.436167:0:5793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969463.436186:0:5793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fabd0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb634ad expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969463.436244:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabd16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969463.436257:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabd16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969463.436269:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabd16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969463.436474:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783969463.436478:0:5793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1783969463.436559:0:5793:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabd16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969463.436585:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60f200/0xbacf56d076fabd0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb634ad expref: 7 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969463.436603:0:5793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabd16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb634ad expref: 6 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969463.436619:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac785336e00) 00010000:00010000:1.0:1783969463.436622:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783969463.436625:0:5793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bf60ea00, rc 0) 00000100:00100000:1.0:1783969463.436691:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+6:12071:x1870627272230912:12345-192.168.203.39@tcp:101:lsof.0 Request processed in 544us (1565us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969463.436698:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 239 00000100:00080000:3.0:1783969463.436840:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783969463.845125:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969463.862961:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969463.863012:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969463.863047:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969463.863081:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969463.863265:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272231296 00000100:00100000:1.0:1783969463.863275:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272231296 00000100:00100000:1.0:1783969463.863328:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272231424 00000100:00100000:1.0:1783969463.863331:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272231424 00000100:00100000:1.0:1783969463.863356:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 77 00000100:00100000:1.0:1783969463.863366:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+7:2349:x1870627272231296:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969463.863433:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786092a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+7:2349:x1870627272231296:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 68us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969463.863440:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 77 00000100:00100000:1.0:1783969463.863456:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 78 00000100:00100000:1.0:1783969463.863463:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+5:2349:x1870627272231424:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969463.863486:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786091c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03985e57-ffb4-414b-b30c-e72697857d4f+5:2349:x1870627272231424:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969463.863491:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 78 00000100:00100000:0.0:1783969463.863640:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272231040 00000100:00100000:0.0:1783969463.863644:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272231040 00000100:00100000:0.0:1783969463.863678:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 295 00000100:00100000:0.0:1783969463.863685:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2349:x1870627272231040:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969463.863728:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2349:x1870627272231040:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 43us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969463.863734:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 295 00000100:00100000:3.0:1783969463.863855:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272231168 00000100:00100000:3.0:1783969463.863888:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272231168 00000100:00100000:3.0:1783969463.863920:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 154 00000100:00100000:3.0:1783969463.863927:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+19:2349:x1870627272231168:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969463.863964:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03985e57-ffb4-414b-b30c-e72697857d4f+19:2349:x1870627272231168:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 37us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969463.863971:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 154 00000100:00080000:3.0:1783969463.863988:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783969463.864005:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783969464.869380:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783969465.021213:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1783969465.021233:0:5816:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1783969465.021372:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1783969465.021392:0:5827:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1783969465.894971:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969466.917174:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969466.982787:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac786090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280598528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783969466.982849:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969467.002309:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280598528 00000100:00100000:2.0:1783969467.002322:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280598528 00000100:00100000:2.0:1783969467.002386:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783969467.002396:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280598528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969467.002428:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783969467.002582:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280598528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 188us (19732us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969467.002589:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783969467.002634:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac786090700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280598528:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783969467.003886:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969467.495343:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870627280598784:0@lo:400:kworker.0 00000100:00100000:2.0:1783969467.495417:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969467.495479:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783969467.495486:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280598656:0@lo:400:kworker.0 00000100:00100000:2.0:1783969467.495515:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969467.495536:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280599168:0@lo:400:kworker.0 00000100:00100000:2.0:1783969467.495560:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969467.495585:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1870627280599040:0@lo:400:kworker.0 00000100:00100000:2.0:1783969467.495608:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969467.495624:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783969467.495629:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1870627280598912:0@lo:400:kworker.0 00000100:00100000:2.0:1783969467.495649:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969467.495677:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280598784 00000100:00100000:2.0:1783969467.495683:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280598784 00000100:00100000:1.0:1783969467.496282:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280598656 00000100:00100000:1.0:1783969467.496288:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280598656 00000100:00100000:1.0:1783969467.496398:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1783969467.496408:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+19:3288:x1870627280598656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969467.496468:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c893ad09-f78f-4711-bea5-6489668294ed+19:3288:x1870627280598656:12345-0@lo:400:kworker.0 Request processed in 61us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969467.496475:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1783969467.496505:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280599168 00000100:00100000:1.0:1783969467.496508:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280599168 00000100:00100000:1.0:1783969467.496536:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783969467.496542:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280599168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969467.496572:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786092300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280599168:12345-0@lo:400:kworker.0 Request processed in 29us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969467.496578:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783969467.499205:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280599040 00000100:00100000:2.0:1783969467.499218:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280599040 00000100:00100000:0.0:1783969467.499308:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280598912 00000100:00100000:0.0:1783969467.499312:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280598912 00000100:00100000:0.0:1783969467.499343:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783969467.499352:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870627280598784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969467.499432:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870627280598784:12345-0@lo:400:kworker.0 Request processed in 80us (4015us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969467.499439:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783969467.499457:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783969467.499464:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1870627280599040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969467.499496:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1870627280599040:12345-0@lo:400:kworker.0 Request processed in 33us (3887us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969467.499502:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783969467.499514:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783969467.499529:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1870627280598912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969467.499559:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1870627280598912:12345-0@lo:400:kworker.0 Request processed in 32us (3910us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969467.499565:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:1.0:1783969467.499670:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783969467.499674:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969467.499710:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280598656:0@lo:400:kworker.0 00000100:00100000:1.0:1783969467.499726:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280599168:0@lo:400:kworker.0 00000100:00100000:1.0:1783969467.499736:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870627280598784:0@lo:400:kworker.0 00000100:00100000:3.0:1783969467.500202:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3286:1870627280598912:0@lo:400:kworker.0 00000100:00100000:3.0:1783969467.500215:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1870627280599040:0@lo:400:kworker.0 00000001:02000400:1.0:1783969467.520018:0:12609:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 15:04:26 (1783969466) 00010000:00010000:3.0:1783969467.941583:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969468.006265:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280599296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969468.006345:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969468.006692:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280599296 00000100:00100000:2.0:1783969468.006700:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280599296 00000100:00100000:2.0:1783969468.006757:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1783969468.006777:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280599296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783969468.006812:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783969468.006885:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280599296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969468.006901:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783969468.007140:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280599296:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783969468.965072:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969468.982785:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969468.982835:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969468.982899:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969468.982920:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969468.982944:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969468.983023:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272231680 00000100:00100000:3.0:1783969468.983032:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272231680 00000100:00100000:3.0:1783969468.983089:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272232064 00000100:00100000:3.0:1783969468.983092:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272232064 00000100:00100000:3.0:1783969468.983120:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 158 00000100:00100000:3.0:1783969468.983131:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+18:2348:x1870627272231680:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969468.983219:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786090380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:03985e57-ffb4-414b-b30c-e72697857d4f+18:2348:x1870627272231680:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 78us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969468.983227:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 158 00000100:00100000:3.0:1783969468.983245:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 159 00000100:00100000:3.0:1783969468.983251:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+6:2348:x1870627272232064:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969468.983277:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+6:2348:x1870627272232064:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 26us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969468.983283:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 159 00000100:00100000:1.0:1783969468.983632:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272231936 00000100:00100000:1.0:1783969468.983637:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272231936 00000100:00100000:1.0:1783969468.983692:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272231808 00000100:00100000:1.0:1783969468.983700:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272231808 00000100:00100000:1.0:1783969468.983723:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 80 00000100:00100000:1.0:1783969468.983731:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+5:2348:x1870627272231936:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969468.983778:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786091880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+5:2348:x1870627272231936:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 47us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969468.983784:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 80 00000100:00100000:1.0:1783969468.983797:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 81 00000100:00100000:1.0:1783969468.983803:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+7:2348:x1870627272231808:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969468.983827:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+7:2348:x1870627272231808:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969468.983832:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 81 00000100:00100000:1.0:1783969468.983847:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272231552 00000100:00100000:1.0:1783969468.983850:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272231552 00000100:00100000:1.0:1783969468.983896:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 297 00000100:00100000:1.0:1783969468.983902:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2348:x1870627272231552:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969468.983926:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2348:x1870627272231552:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969468.983932:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 297 00000100:00080000:2.0:1783969468.984221:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783969468.984226:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783969468.984228:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783969469.989189:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969471.013150:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969472.037159:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969472.101121:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a787d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280599424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969472.101196:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969472.101325:0:6597:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280599424 00000100:00100000:2.0:1783969472.101334:0:6597:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280599424 00000100:00100000:2.0:1783969472.101404:0:6597:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783969472.101414:0:6597:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280599424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969472.101456:0:6597:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783969472.101511:0:6597:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280599424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969472.101519:0:6597:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783969472.101638:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a787d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280599424:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783969472.101646:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1783969472.165096:0:11535:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783969472.165105:0:11535:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783969472.165925:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1783969472.165934:0:11535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783969472.205174:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969472.205321:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272232320 00000100:00100000:3.0:1783969472.205331:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272232320 00000100:00100000:3.0:1783969472.205424:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 66 00000100:00100000:3.0:1783969472.205445:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+18:12292:x1870627272232320:12345-192.168.203.39@tcp:35:umount.0 00000100:00080000:1.0:1783969472.205532:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969472.206072:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+19:12292:x1870627272232320:12345-192.168.203.39@tcp:35:umount.0 Request processed in 630us (906us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1783969472.206081:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 66 00000100:00100000:1.0:1783969472.217967:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969472.218180:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272232576 00000100:00100000:3.0:1783969472.218189:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272232576 00000100:00100000:3.0:1783969472.218255:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 67 00000100:00100000:3.0:1783969472.218267:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+19:12292:x1870627272232576:12345-192.168.203.39@tcp:35:umount.0 00000100:00100000:3.0:1783969472.219558:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+20:12292:x1870627272232576:12345-192.168.203.39@tcp:35:umount.0 Request processed in 876us (1184us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1783969472.219570:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 67 00000100:00100000:0.0:1783969472.232169:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969472.232253:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272232832 00000100:00100000:2.0:1783969472.232264:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272232832 00000100:00100000:2.0:1783969472.232321:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 68 00000100:00100000:2.0:1783969472.232339:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7861ea050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+20:12292:x1870627272232832:12345-192.168.203.39@tcp:35:umount.0 00000100:00100000:2.0:1783969472.233518:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7861ea050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03985e57-ffb4-414b-b30c-e72697857d4f+21:12292:x1870627272232832:12345-192.168.203.39@tcp:35:umount.0 Request processed in 1179us (1347us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1783969472.233528:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 68 00000100:00100000:2.0:1783969472.245770:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969472.245898:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272233088 00000100:00100000:3.0:1783969472.245908:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272233088 00000100:00100000:0.0:1783969472.246043:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 69 00000100:00100000:0.0:1783969472.246056:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+21:12292:x1870627272233088:12345-192.168.203.39@tcp:35:umount.0 00000100:00100000:0.0:1783969472.246425:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03985e57-ffb4-414b-b30c-e72697857d4f+22:12292:x1870627272233088:12345-192.168.203.39@tcp:35:umount.0 Request processed in 370us (664us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1783969472.246441:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 69 00000100:00100000:1.0:1783969472.253950:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969472.254004:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969472.254076:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969472.254159:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272233216 00000100:00100000:3.0:1783969472.254169:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272233216 00000100:00100000:3.0:1783969472.254242:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272233472 00000100:00100000:3.0:1783969472.254246:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272233472 00000100:00100000:3.0:1783969472.254260:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272233344 00000100:00100000:3.0:1783969472.254263:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272233344 00000100:00100000:3.0:1783969472.254279:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:3.0:1783969472.254288:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+15:2351:x1870627272233216:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969472.254303:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969472.254322:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7c21e2200/0xbacf56d076faad8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63038 expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969472.254352:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969472.254918:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+14:2351:x1870627272233216:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 626us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969472.254927:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:3.0:1783969472.254950:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:3.0:1783969472.254959:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+13:2351:x1870627272233472:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969472.254969:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969472.254981:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7c21e3400/0xbacf56d076faafa2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63103 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969472.254992:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969472.255014:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+12:2351:x1870627272233472:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 58us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969472.255020:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:3.0:1783969472.255032:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:3.0:1783969472.255038:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+11:2351:x1870627272233344:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969472.255044:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969472.255052:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7bfb92a00/0xbacf56d076faacf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63000 expref: 11 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969472.255066:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969472.255083:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:2351:x1870627272233344:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 46us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969472.255089:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:3.0:1783969472.258021:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969472.258164:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272233600 00000100:00100000:1.0:1783969472.258174:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272233600 00000100:00100000:1.0:1783969472.258252:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 72 00000100:00100000:1.0:1783969472.258262:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+5:2347:x1870627272233600:12345-192.168.203.39@tcp:9:umount.0 00000020:00000080:1.0:1783969472.258291:0:6593:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076fab066 00000100:00080000:1.0:1783969472.258299:0:6593:0:(import.c:65:import_set_state_nolock()) ffff9ac7ba0dd000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783969472.258348:0:6593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1783969472.258655:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03985e57-ffb4-414b-b30c-e72697857d4f+2:2347:x1870627272233600:12345-192.168.203.39@tcp:9:umount.0 Request processed in 393us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969472.258664:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 72 00000100:00080000:2.0:1783969472.258918:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783969472.259342:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969472.269011:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969472.269312:0:9934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272233984 00000100:00100000:2.0:1783969472.269323:0:9934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272233984 00000100:00100000:2.0:1783969472.269421:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 73 00000100:00080000:1.0:1783969472.269570:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969472.269603:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+7:2347:x1870627272233984:12345-192.168.203.39@tcp:9:umount.0 00000020:00000080:2.0:1783969472.269633:0:9934:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076fab2ce 00000020:00010000:2.0:1783969472.269640:0:9934:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9ac7c18d0800: total 0 00000100:00080000:2.0:1783969472.269645:0:9934:0:(import.c:65:import_set_state_nolock()) ffff9ac7c18d1000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783969472.269691:0:9934:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1783969472.269988:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03985e57-ffb4-414b-b30c-e72697857d4f+5:2347:x1870627272233984:12345-192.168.203.39@tcp:9:umount.0 Request processed in 557us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969472.270007:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 73 00000020:00010000:0.0:1783969472.270081:0:5781:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9ac7c18d0800: total 0 00010000:00010000:0.0:1783969472.270113:0:5781:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9ac7c18d0800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1783969472.270175:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006dbf6aa6/0xbacf56d076fab66a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632d8 expref: 4 pid: 9934 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969472.270218:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b308c124/0xbacf56d076fabd08 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb634a6 expref: 3 pid: 6593 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969472.270234:0:5781:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9ac7c18d0800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1783969472.270244:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969472.270246:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969472.270248:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969472.290899:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969472.294988:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272235008 00000100:00100000:3.0:1783969472.295004:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272235008 00000100:00100000:2.0:1783969472.295616:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 240 00000100:00100000:2.0:1783969472.295629:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+22:2347:x1870627272235008:12345-192.168.203.39@tcp:39:umount.0 00000020:00000080:2.0:1783969472.295661:0:5795:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faad02 00000020:00010000:2.0:1783969472.295681:0:5795:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9ac6827e4800: total 0 00000100:00080000:2.0:1783969472.295686:0:5795:0:(import.c:65:import_set_state_nolock()) ffff9ac6827e6800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783969472.295776:0:5795:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1783969472.296189:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03985e57-ffb4-414b-b30c-e72697857d4f+21:2347:x1870627272235008:12345-192.168.203.39@tcp:39:umount.0 Request processed in 561us (5328us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1783969472.296197:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 240 00000020:00010000:1.0:1783969472.303597:0:5782:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9ac6827e4800: total 0 00010000:00010000:1.0:1783969472.303760:0:5782:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9ac6827e4800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1783969472.303962:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:1.0:1783969472.303967:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783969472.303976:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92200/0xbacf56d076fab03c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6312d expref: 20 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.303998:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:1.0:1783969472.304000:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783969472.304004:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93800/0xbacf56d076fabbe9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63459 expref: 19 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.304017:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:1.0:1783969472.304032:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783969472.305873:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099800/0xbacf56d076fab6e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632fb expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.305918:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:1.0:1783969472.305922:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783969472.305928:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60e800/0xbacf56d076fab54b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6328b expref: 17 pid: 6618 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.305943:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac785336e00) 00010000:00010000:1.0:1783969472.305945:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783969472.305949:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044a00/0xbacf56d076fab6cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632f4 expref: 16 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.305962:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac790086e00) 00010000:00010000:1.0:1783969472.306143:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969472.306149:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb92c00/0xbacf56d076faafe8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63118 expref: 15 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.306183:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:1.0:1783969472.306186:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783969472.306190:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6a00/0xbacf56d076fabcf3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6349f expref: 14 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.306204:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:1.0:1783969472.306206:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783969472.306210:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045200/0xbacf56d076fab62b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632c3 expref: 13 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.306246:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9ac785336900) 00010000:00010000:1.0:1783969472.306248:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783969472.306252:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2044c00/0xbacf56d076fab655 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb632d1 expref: 12 pid: 10288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.306268:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ac78c550200) 00010000:00010000:1.0:1783969472.306271:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783969472.306274:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93c00/0xbacf56d076fabcc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63491 expref: 11 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.306288:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9ac790086100) 00010000:00010000:1.0:1783969472.306290:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783969472.306293:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7c2045800/0xbacf56d076fab329 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb631ff expref: 10 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.306306:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ac790086f00) 00010000:00010000:1.0:1783969472.306308:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783969472.306311:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bfb93600/0xbacf56d076faafcc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63111 expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.306322:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ac785336200) 00010000:00010000:1.0:1783969472.306324:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783969472.306327:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7e00/0xbacf56d076fab9c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb633cd expref: 8 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969472.306339:0:5782:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9ac6827e4800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1783969472.306379:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969472.306388:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969472.306391:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969472.613537:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280599552:0@lo:400:kworker.0 00000100:00100000:2.0:1783969472.613612:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969472.613671:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785317100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280600064:0@lo:400:kworker.0 00000100:00100000:2.0:1783969472.613700:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969472.613724:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783969472.613759:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1870627280599936:0@lo:400:kworker.0 00000100:00100000:2.0:1783969472.613789:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969472.614012:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280599552 00000100:00100000:3.0:1783969472.614026:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280599552 00000100:00100000:3.0:1783969472.614218:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1783969472.614228:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3286:x1870627280599552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969472.614290:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c893ad09-f78f-4711-bea5-6489668294ed+19:3286:x1870627280599552:12345-0@lo:400:kworker.0 Request processed in 64us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969472.614297:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1783969472.614330:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280599936 00000100:00100000:3.0:1783969472.614334:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280599936 00000100:00100000:3.0:1783969472.614446:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783969472.614454:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1870627280599936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969472.614489:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1870627280599936:12345-0@lo:400:kworker.0 Request processed in 37us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969472.614496:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783969472.614604:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280599680:0@lo:400:kworker.0 00000100:00100000:1.0:1783969472.614635:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969472.614655:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969472.614661:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280599808:0@lo:400:kworker.0 00000100:00100000:1.0:1783969472.614684:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783969472.614724:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969472.614750:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280600064 00000100:00100000:1.0:1783969472.614754:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280600064 00000100:00100000:1.0:1783969472.614787:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783969472.614794:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a787c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280600064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969472.614828:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a787c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280600064:12345-0@lo:400:kworker.0 Request processed in 34us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969472.614834:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1783969472.614852:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783969472.615264:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280599680 00000100:00100000:3.0:1783969472.615269:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280599680 00000100:00100000:3.0:1783969472.615296:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280599808 00000100:00100000:3.0:1783969472.615299:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280599808 00000100:00100000:3.0:1783969472.615324:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1783969472.615330:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280599680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969472.615371:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280599680:12345-0@lo:400:kworker.0 Request processed in 41us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969472.615377:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783969472.615467:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783969472.615476:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280599808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969472.615510:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280599808:12345-0@lo:400:kworker.0 Request processed in 36us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969472.615517:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:1.0:1783969472.615535:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969472.615583:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280599808:0@lo:400:kworker.0 00000100:00100000:1.0:1783969472.615596:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280599680:0@lo:400:kworker.0 00000100:00100000:2.0:1783969472.615917:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1870627280599936:0@lo:400:kworker.0 00000100:00100000:2.0:1783969472.615930:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280599552:0@lo:400:kworker.0 00000100:00100000:2.0:1783969472.615941:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785317100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280600064:0@lo:400:kworker.0 00010000:00010000:0.0:1783969473.064782:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969473.127400:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783969473.127426:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280600192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783969473.127497:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969473.127650:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280600192 00000100:00100000:0.0:1783969473.127658:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280600192 00000100:00100000:0.0:1783969473.127716:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783969473.127736:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785314e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280600192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783969473.127773:0:6596:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783969473.127826:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785314e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280600192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969473.127834:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783969473.128472:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280600192:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783969474.086112:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969474.101268:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969474.101330:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969474.101439:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272235136 00000100:00100000:2.0:1783969474.101448:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272235136 00000100:00100000:2.0:1783969474.101500:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 299 00000100:00100000:2.0:1783969474.101510:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:2349:x1870627272235136:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783969474.101594:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:2349:x1870627272235136:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 84us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969474.101601:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 299 00000100:00100000:3.0:1783969474.102818:0:6618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272235264 00000100:00100000:3.0:1783969474.102836:0:6618:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272235264 00000100:00100000:3.0:1783969474.102924:0:6618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 163 00000100:00100000:3.0:1783969474.102945:0:6618:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+6:2349:x1870627272235264:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969474.103009:0:6618:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+6:2349:x1870627272235264:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 67us (1761us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969474.103016:0:6618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 163 00000100:00080000:1.0:1783969474.103977:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969474.417215:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969474.417261:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969474.417412:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272235392 00000100:00100000:0.0:1783969474.417433:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272235392 00000100:00100000:0.0:1783969474.417494:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272235520 00000100:00100000:0.0:1783969474.417497:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272235520 00000100:00100000:0.0:1783969474.417531:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:0.0:1783969474.417541:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+11:2350:x1870627272235392:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969474.417555:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969474.417575:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac781497200/0xbacf56d076faaddb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63077 expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969474.417594:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969474.417651:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+10:2350:x1870627272235392:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 111us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969474.417658:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:0.0:1783969474.417675:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:0.0:1783969474.417681:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7860bd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+9:2351:x1870627272235520:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969474.417689:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969474.417699:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7c21e3c00/0xbacf56d076faaf9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb630fc expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969474.417735:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969474.417759:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7860bd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+8:2351:x1870627272235520:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 77us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969474.417765:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:0.0:1783969474.420266:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969474.423154:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969474.423341:0:10288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272235904 00000100:00100000:2.0:1783969474.423352:0:10288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272235904 00000100:00100000:2.0:1783969474.423423:0:10288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 241 00000100:00100000:2.0:1783969474.423435:0:10288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+6:2347:x1870627272235904:12345-192.168.203.39@tcp:39:umount.0 00000020:00000080:2.0:1783969474.423479:0:10288:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faade9 00000020:00010000:2.0:1783969474.423490:0:10288:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9ac7c18d2800: total 0 00000100:00080000:2.0:1783969474.423495:0:10288:0:(import.c:65:import_set_state_nolock()) ffff9ac7c18d5000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783969474.423522:0:10288:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:2.0:1783969474.423741:0:10288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4af233ee-6a25-4eaf-90cc-2e5dc362fbb6+5:2347:x1870627272235904:12345-192.168.203.39@tcp:39:umount.0 Request processed in 307us (596us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1783969474.423749:0:10288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 241 00000020:00010000:0.0:1783969474.424094:0:5782:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9ac7c18d2800: total 0 00010000:00010000:0.0:1783969474.424099:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969474.424139:0:5782:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9ac7c18d2800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1783969474.424173:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac785336e00) 00010000:00010000:0.0:1783969474.424177:0:5782:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783969474.424185:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac7bf60ea00/0xbacf56d076fabd16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb634ad expref: 4 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969474.424221:0:5782:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9ac7c18d2800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1783969474.424232:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969474.424234:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969474.424235:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969474.424926:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272235648 00000100:00100000:1.0:1783969474.424934:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272235648 00000100:00100000:1.0:1783969474.424992:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:1.0:1783969474.425002:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+8:2348:x1870627272235648:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783969474.425015:0:5778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969474.425028:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac781497400/0xbacf56d076faadd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6304d expref: 8 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969474.425041:0:5778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969474.425093:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+7:2348:x1870627272235648:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 86us (4898us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969474.425101:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:3.0:1783969474.450249:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969474.450395:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272236160 00000100:00100000:0.0:1783969474.450406:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272236160 00000100:00100000:0.0:1783969474.450471:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 300 00000100:00100000:0.0:1783969474.450481:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786bf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+7:2347:x1870627272236160:12345-192.168.203.39@tcp:251:umount.0 00000020:00000080:0.0:1783969474.450525:0:5787:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faacdf 00000020:00010000:0.0:1783969474.450532:0:5787:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9ac7ba659000: total 0 00000100:00080000:0.0:1783969474.450537:0:5787:0:(import.c:65:import_set_state_nolock()) ffff9ac7ba65d000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1783969474.450904:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786bf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f76c8f1a-030e-4d3a-84d5-8ee5d8211d03+3:2347:x1870627272236160:12345-192.168.203.39@tcp:251:umount.0 Request processed in 381us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969474.450913:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 300 00000020:00010000:1.0:1783969474.453077:0:8303:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9ac7ba659000: total 0 00010000:00010000:1.0:1783969474.453144:0:8303:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9ac7ba659000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1783969474.453183:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7bfb92000/0xbacf56d076faad95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6303f expref: 2 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969474.453200:0:8303:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9ac7ba659000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1783969474.453212:0:8303:0:(genops.c:906:class_export_put()) final put ffff9ac7ba659000/f76c8f1a-030e-4d3a-84d5-8ee5d8211d03 00010000:00010000:1.0:1783969474.453278:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969474.453280:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969474.453282:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783969474.453310:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7ba659000/f76c8f1a-030e-4d3a-84d5-8ee5d8211d03 for MGS 00000020:00000080:3.0:1783969474.453413:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ac7ba65d000 for MGS 00010000:00010000:0.0:1783969475.113250:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783969475.231484:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:2.0:1783969475.231502:0:5816:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4af233ee-6a25-4eaf-90cc-2e5dc362fbb6 00000001:00080000:2.0:1783969475.231518:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1783969475.231521:0:5816:0:(genops.c:906:class_export_put()) final put ffff9ac7c18d2800/4af233ee-6a25-4eaf-90cc-2e5dc362fbb6 00000001:00100000:2.0:1783969475.232124:0:5816:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 03985e57-ffb4-414b-b30c-e72697857d4f 00000001:00080000:2.0:1783969475.232132:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1783969475.232144:0:5816:0:(genops.c:906:class_export_put()) final put ffff9ac6827e4800/03985e57-ffb4-414b-b30c-e72697857d4f 00000020:00000080:3.0:1783969475.232166:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7c18d2800/4af233ee-6a25-4eaf-90cc-2e5dc362fbb6 for lustre-MDT0000 00000020:00000080:3.0:1783969475.233180:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac6827e4800/03985e57-ffb4-414b-b30c-e72697857d4f for lustre-MDT0000 00000020:00000080:3.0:1783969475.233324:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ac7c18d5000 for lustre-MDT0000 00000020:00000080:3.0:1783969475.233329:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ac6827e6800 for lustre-MDT0000 00000001:00100000:1.0:1783969475.244767:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 03985e57-ffb4-414b-b30c-e72697857d4f 00000020:00000080:1.0:1783969475.244775:0:6622:0:(genops.c:906:class_export_put()) final put ffff9ac7c18d0800/03985e57-ffb4-414b-b30c-e72697857d4f 00000020:00000080:3.0:1783969475.245108:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7c18d0800/03985e57-ffb4-414b-b30c-e72697857d4f for lustre-OST0000 00000020:00000080:3.0:1783969475.245154:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ac7c18d1000 for lustre-OST0000 00000001:00100000:1.0:1783969475.767620:0:7494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 03985e57-ffb4-414b-b30c-e72697857d4f 00000020:00000080:1.0:1783969475.767635:0:7494:0:(genops.c:906:class_export_put()) final put ffff9ac7ba0d8000/03985e57-ffb4-414b-b30c-e72697857d4f 00000020:00000080:1.0:1783969475.767662:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7ba0d8000/03985e57-ffb4-414b-b30c-e72697857d4f for lustre-OST0001 00000020:00000080:1.0:1783969475.767701:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ac7ba0dd000 for lustre-OST0001 00000020:01000004:0.0:1783969476.122605:0:12811:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00010000:00010000:0.0:1783969476.138650:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783969476.138983:0:12811:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1783969476.139096:0:12811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2800/0xbacf56d076faad64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad6b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.139111:0:12811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2800/0xbacf56d076faad64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faad6b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.139119:0:12811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2800/0xbacf56d076faad64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbacf56d076faad6b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.139127:0:12811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2800/0xbacf56d076faad64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbacf56d076faad6b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.139144:0:12811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783969476.139150:0:12811:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783969476.139174:0:12811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783969476.139179:0:12811:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783969476.139184:0:12811:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783969476.139208:0:12811:0:(import.c:65:import_set_state_nolock()) ffff9ac7a70ea800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1783969476.139368:0:8303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969476.139375:0:8303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2800/0xbacf56d076faad64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xbacf56d076faad6b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969476.139383:0:8303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c21e2800 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:1.0:1783969476.139387:0:8303:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2800/0xbacf56d076faad64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xbacf56d076faad6b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969476.139395:0:8303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2800/0xbacf56d076faad64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xbacf56d076faad6b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783969476.139403:0:8303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2800/0xbacf56d076faad64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xbacf56d076faad6b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969476.139409:0:8303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783969476.139411:0:8303:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783969476.139413:0:8303:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783969476.139442:0:8303:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2800/0xbacf56d076faad64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbacf56d076faad6b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969476.139447:0:8303:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783969476.139469:0:8303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2800/0xbacf56d076faad64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbacf56d076faad6b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969476.139476:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2800/0xbacf56d076faad64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbacf56d076faad6b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969476.139486:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969476.139498:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969476.139500:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969476.139534:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280600448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783969476.139597:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969476.139659:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280600448 00000100:00100000:1.0:1783969476.139665:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280600448 00000100:00100000:1.0:1783969476.139723:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783969476.139732:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c893ad09-f78f-4711-bea5-6489668294ed+19:3288:x1870627280600448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783969476.139744:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969476.139759:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac783de6600/0xbacf56d076faad6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbacf56d076faad64 expref: 19 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969476.139771:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969476.139803:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c893ad09-f78f-4711-bea5-6489668294ed+18:3288:x1870627280600448:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969476.139811:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783969476.139847:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c893ad09-f78f-4711-bea5-6489668294ed:3288:1870627280600448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783969476.139929:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1870627280600320:0@lo:39:umount.0 00000100:00100000:2.0:1783969476.139966:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969476.140129:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280600320 00000100:00100000:1.0:1783969476.140134:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280600320 00000100:00100000:1.0:1783969476.140169:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1783969476.140176:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1870627280600320:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783969476.140195:0:5793:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faaaee 00000100:00080000:1.0:1783969476.140202:0:5793:0:(import.c:65:import_set_state_nolock()) ffff9ac7a7ba8800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783969476.140261:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3284:x1870627280600320:12345-0@lo:39:umount.0 Request processed in 85us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969476.140268:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1783969476.140273:0:5793:0:(genops.c:906:class_export_put()) final put ffff9ac7a7ba9800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1783969476.140297:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7a7ba9800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1783969476.140345:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ac7a7ba8800 for lustre-MDT0000 00000100:00080000:1.0:1783969476.140371:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9ac7a70ea800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:3.0:1783969476.140434:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969476.140641:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1870627280600320:0@lo:39:umount.0 00000100:00080000:0.0:1783969476.140681:0:12811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783969476.140685:0:12811:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783969476.140689:0:12811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783969476.146396:0:12811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faad72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad79 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.146412:0:12811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faad72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faad79 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.146436:0:12811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faad72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xbacf56d076faad79 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.146442:0:12811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faad72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xbacf56d076faad79 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.146617:0:12811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783969476.146626:0:12811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac780030400/0xbacf56d076faac99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaca0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.146633:0:12811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac780030400/0xbacf56d076faac99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faaca0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.146640:0:12811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac780030400/0xbacf56d076faac99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbacf56d076faaca0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.146646:0:12811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9ac780030400/0xbacf56d076faac99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbacf56d076faaca0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969476.146674:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783969476.146682:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faad72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xbacf56d076faad79 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969476.146689:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac781497a00 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:1.0:1783969476.146692:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faad72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xbacf56d076faad79 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969476.146700:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faad72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xbacf56d076faad79 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783969476.146717:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faad72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xbacf56d076faad79 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969476.146723:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783969476.146726:0:5782:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1783969476.146758:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faad72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbacf56d076faad79 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969476.146764:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783969476.146829:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280600576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783969476.146913:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783969476.146998:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faad72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbacf56d076faad79 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969476.147006:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac781497a00/0xbacf56d076faad72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbacf56d076faad79 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969476.147104:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280600576 00000100:00100000:3.0:1783969476.147112:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280600576 00000100:00100000:3.0:1783969476.147157:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783969476.147165:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c893ad09-f78f-4711-bea5-6489668294ed+18:3285:x1870627280600576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969476.147177:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969476.147190:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7c21e2000/0xbacf56d076faad79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbacf56d076faad72 expref: 18 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969476.147204:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783969476.147264:0:12811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783969476.147272:0:12811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faaf8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaf94 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.147280:0:12811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faaf8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faaf94 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.147286:0:12811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faaf8d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbacf56d076faaf94 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.147306:0:12811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faaf8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbacf56d076faaf94 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.147319:0:12811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783969476.147324:0:12811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2600/0xbacf56d076faaa4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaa54 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.147331:0:12811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2600/0xbacf56d076faaa4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faaa54 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.147337:0:12811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2600/0xbacf56d076faaa4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbacf56d076faaa54 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.147342:0:12811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2600/0xbacf56d076faaa4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbacf56d076faaa54 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.147349:0:12811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1783969476.147352:0:12811:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1783969476.147356:0:12811:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1783969476.147379:0:12811:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1783969476.147384:0:12811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1783969476.147388:0:12811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783969476.147392:0:12811:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1783969476.147398:0:12811:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9ac782f9b800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783969476.147403:0:12811:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9ac7bf764800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783969476.147408:0:12811:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9ac7882b19c0) has exports, disconnecting them 00000020:00080000:0.0:1783969476.147412:0:12811:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ac782f9b800), last request at 1783969472 00000020:00000080:0.0:1783969476.147419:0:12811:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faac61 00000100:00080000:0.0:1783969476.147440:0:12811:0:(import.c:65:import_set_state_nolock()) ffff9ac782f98800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783969476.147482:0:12811:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ac782f9b800): rc 0 00000020:00000080:0.0:1783969476.147484:0:12811:0:(genops.c:906:class_export_put()) final put ffff9ac782f9b800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1783969476.147493:0:12811:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ac7bf764800), last request at 1783969472 00000020:00000080:0.0:1783969476.147496:0:12811:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faab88 00000100:00080000:0.0:1783969476.147502:0:12811:0:(import.c:65:import_set_state_nolock()) ffff9ac7bf767800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783969476.147507:0:12811:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ac7bf764800): rc 0 00000020:00000080:0.0:1783969476.147509:0:12811:0:(genops.c:906:class_export_put()) final put ffff9ac7bf764800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1783969476.147518:0:12811:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffc0f304107ae0 00000100:00080000:0.0:1783969476.147535:0:12811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783969476.147538:0:12811:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1783969476.147550:0:12811:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1783969476.147607:0:12811:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1783969476.147620:0:12811:0:(import.c:65:import_set_state_nolock()) ffff9ac7c19c0000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1783969476.147633:0:12811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783969476.147635:0:12811:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1783969476.147643:0:12811:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1783969476.147697:0:12811:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1783969476.147705:0:12811:0:(import.c:65:import_set_state_nolock()) ffff9ac7c19c5000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1783969476.147744:0:12811:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9ac7882b19c0) has no exports 00010000:00010000:1.0:1783969476.147792:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783969476.147804:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac780030400/0xbacf56d076faac99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbacf56d076faaca0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969476.147811:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac780030400 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:1.0:1783969476.147814:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac780030400/0xbacf56d076faac99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbacf56d076faaca0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969476.147822:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac780030400/0xbacf56d076faac99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbacf56d076faaca0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783969476.147829:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac780030400/0xbacf56d076faac99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbacf56d076faaca0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969476.147834:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1783969476.147837:0:5782:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1783969476.147839:0:5782:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1783969476.147856:0:5782:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac780030400/0xbacf56d076faac99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbacf56d076faaca0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969476.147891:0:5782:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783969476.147984:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c893ad09-f78f-4711-bea5-6489668294ed+17:3285:x1870627280600576:12345-0@lo:103:ldlm_bl.0 Request processed in 819us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969476.147993:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783969476.148129:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280600960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783969476.148161:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783969476.148196:0:8303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783969476.148201:0:8303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faaf8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbacf56d076faaf94 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.148207:0:8303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac781496000 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:0.0:1783969476.148210:0:8303:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faaf8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbacf56d076faaf94 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.148229:0:8303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faaf8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbacf56d076faaf94 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969476.148235:0:8303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faaf8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbacf56d076faaf94 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969476.148239:0:8303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783969476.148241:0:8303:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1783969476.148243:0:8303:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1783969476.148257:0:8303:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faaf8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbacf56d076faaf94 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.148263:0:8303:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969476.148276:0:8303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faaf8d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbacf56d076faaf94 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.148284:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac781496000/0xbacf56d076faaf8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbacf56d076faaf94 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.148293:0:8303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969476.148296:0:8303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2600/0xbacf56d076faaa4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbacf56d076faaa54 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.148301:0:8303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c21e2600 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:0.0:1783969476.148304:0:8303:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2600/0xbacf56d076faaa4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbacf56d076faaa54 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.148310:0:8303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2600/0xbacf56d076faaa4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbacf56d076faaa54 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969476.148325:0:8303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2600/0xbacf56d076faaa4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbacf56d076faaa54 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969476.148331:0:8303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1783969476.148332:0:8303:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1783969476.148334:0:8303:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1783969476.148349:0:8303:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2600/0xbacf56d076faaa4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbacf56d076faaa54 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.148355:0:8303:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969476.148361:0:8303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2600/0xbacf56d076faaa4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbacf56d076faaa54 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.148367:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2600/0xbacf56d076faaa4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbacf56d076faaa54 expref: -99 pid: 5774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.148377:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969476.148378:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969476.148380:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969476.148411:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280600960 00000100:00100000:3.0:1783969476.148417:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280600960 00000100:00100000:3.0:1783969476.148451:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783969476.148458:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c893ad09-f78f-4711-bea5-6489668294ed+17:3286:x1870627280600960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969476.148466:0:5779:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969476.148477:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac781496e00/0xbacf56d076faaca0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbacf56d076faac99 expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969476.148488:0:5779:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969476.148515:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c893ad09-f78f-4711-bea5-6489668294ed+16:3286:x1870627280600960:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969476.148521:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1783969476.148534:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969476.148615:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280600960:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783969476.149002:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac780030400/0xbacf56d076faac99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbacf56d076faaca0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969476.149010:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac780030400/0xbacf56d076faac99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbacf56d076faaca0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969476.149031:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969476.149033:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969476.149035:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969476.149051:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac786091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280601088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783969476.149083:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969476.149121:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969476.149127:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280601216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783969476.149149:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1783969476.149175:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac782f9b800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1783969476.149212:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7bf764800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1783969476.149233:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ac782f98800 for lustre-MDT0000 00000020:00000080:1.0:1783969476.149237:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ac7bf767800 for lustre-MDT0000 00000100:00100000:1.0:1783969476.149252:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1870627280600704:0@lo:9:umount.0 00000100:00100000:1.0:1783969476.149281:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969476.149302:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7a7a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1870627280600832:0@lo:9:umount.0 00000100:00100000:1.0:1783969476.149322:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969476.149350:0:9934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280600704 00000100:00100000:1.0:1783969476.149355:0:9934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280600704 00000100:00100000:1.0:1783969476.149387:0:9934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280600832 00000100:00100000:1.0:1783969476.149391:0:9934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280600832 00000100:00100000:1.0:1783969476.149411:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783969476.149417:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1870627280600704:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783969476.149436:0:9934:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faabdc 00000100:00080000:1.0:1783969476.149443:0:9934:0:(import.c:65:import_set_state_nolock()) ffff9ac7c19c5800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783969476.149469:0:9934:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1783969476.149783:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3284:x1870627280600704:12345-0@lo:9:umount.0 Request processed in 365us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969476.149791:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783969476.149805:0:9934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783969476.149811:0:9934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3284:x1870627280600832:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783969476.149821:0:9934:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faacca 00000100:00080000:1.0:1783969476.149826:0:9934:0:(import.c:65:import_set_state_nolock()) ffff9ac7ba65a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783969476.149854:0:9934:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1783969476.150073:0:9934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3284:x1870627280600832:12345-0@lo:9:umount.0 Request processed in 261us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969476.150080:0:9934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1783969476.150100:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783969476.150103:0:5789:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783969476.150114:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969476.150119:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783969476.150140:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9ac7c19c0000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783969476.150147:0:3284:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783969476.150149:0:3284:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783969476.150152:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1870627280600704:0@lo:9:umount.0 00000100:00080000:1.0:1783969476.150163:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9ac7c19c5000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783969476.150172:0:3284:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783969476.150173:0:3284:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783969476.150176:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7a7a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1870627280600832:0@lo:9:umount.0 00000100:00100000:1.0:1783969476.150207:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280601088 00000100:00100000:1.0:1783969476.150210:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280601088 00000100:00100000:1.0:1783969476.150250:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280601216 00000100:00100000:1.0:1783969476.150253:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280601216 00000100:00100000:1.0:1783969476.150268:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783969476.150274:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c893ad09-f78f-4711-bea5-6489668294ed+17:3287:x1870627280601088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783969476.150283:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969476.150298:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7c21e2c00/0xbacf56d076faaf94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbacf56d076faaf8d expref: 17 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969476.150312:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969476.150341:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c893ad09-f78f-4711-bea5-6489668294ed+16:3287:x1870627280601088:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969476.150357:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783969476.150370:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783969476.150376:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c893ad09-f78f-4711-bea5-6489668294ed+15:3287:x1870627280601216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783969476.150385:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969476.150394:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7c21e3200/0xbacf56d076faaa54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbacf56d076faaa4d expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969476.150405:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783969476.150427:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c893ad09-f78f-4711-bea5-6489668294ed+14:3287:x1870627280601216:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969476.150432:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783969476.150456:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280601216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783969476.150464:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac786091180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280601088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783969476.151093:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c893ad09-f78f-4711-bea5-6489668294ed:3285:1870627280600576:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1783969476.158718:0:12811:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9ac7882b19c0) has no exports 00000020:00000080:0.0:1783969476.219068:0:12811:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faaaa8 00000020:00000080:0.0:1783969476.219084:0:12811:0:(genops.c:906:class_export_put()) final put ffff9ac791e24800/lustre-QMT0000_UUID 00000020:01000000:0.0:1783969476.219148:0:12811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1783969476.219451:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac791e24800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1783969476.219481:0:12811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783969476.219491:0:12811:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783969476.219496:0:12811:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9ac7b6434d40) has no exports 00000020:00000080:1.0:1783969476.219797:0:12811:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faaaa1 00000020:00000080:1.0:1783969476.219803:0:12811:0:(genops.c:906:class_export_put()) final put ffff9ac7b6423000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783969476.219892:0:12811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783969476.219900:0:12811:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1783969476.219902:0:12811:0:(genops.c:906:class_export_put()) final put ffff9ac7b6427000/lustre-QMT0000_UUID 00000020:00000080:1.0:1783969476.219905:0:12811:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7b6427000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1783969476.219909:0:12811:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1783969476.220132:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7b6423000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1783969476.220190:0:12811:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9ac7860f4420 - data ffff9ac79efec870/ffff9ac7bf5a8c00 00000020:01000000:1.0:1783969476.220332:0:12811:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9ac798f80ea0 - data ffff9ac79ef28d80/ffff9ac791805c00 00000001:00000004:0.0:1783969476.236012:0:12811:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:2.0:1783969476.343977:0:12811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783969476.343986:0:12811:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1783969476.344012:0:12811:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783969476.344016:0:12811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783969476.344423:0:6642:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783969476.344427:0:6642:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1783969476.344436:0:6642:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1783969476.345732:0:12811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783969476.345738:0:12811:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1783969476.345748:0:12811:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783969476.345750:0:12811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783969476.347370:0:7946:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783969476.347377:0:7946:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1783969476.347392:0:7946:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1783969476.475426:0:12811:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faaa70 00000020:00000080:2.0:1783969476.475438:0:12811:0:(genops.c:906:class_export_put()) final put ffff9ac782f7f800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783969476.476954:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac782f7f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783969476.477120:0:12811:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faaa85 00000020:00000080:2.0:1783969476.477129:0:12811:0:(genops.c:906:class_export_put()) final put ffff9ac7ba73a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783969476.477168:0:12811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1783969476.477173:0:12811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783969476.477188:0:12811:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783969476.477192:0:12811:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9ac7882b3380) has no exports 00000004:01000000:2.0:1783969476.477410:0:12811:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1783969476.477418:0:12811:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faacc3 00000020:00000080:2.0:1783969476.477432:0:12811:0:(genops.c:906:class_export_put()) final put ffff9ac682863000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783969476.481892:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7ba73a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1783969476.485471:0:12811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1783969476.485485:0:12811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783969476.485497:0:12811:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783969476.485503:0:12811:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9ac7b64319c0) has no exports 00000020:00000080:2.0:1783969476.485511:0:12811:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faacbc 00000020:00000080:2.0:1783969476.485520:0:12811:0:(genops.c:906:class_export_put()) final put ffff9ac7c19c2000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783969476.487568:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac682863000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:2.0:1783969476.490634:0:12811:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1783969476.490643:0:12811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783969476.490647:0:12811:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1783969476.490655:0:12811:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783969476.490657:0:12811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783969476.490691:0:12811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783969476.490701:0:12811:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783969476.490719:0:12811:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faabce 00000020:00000080:2.0:1783969476.490728:0:12811:0:(genops.c:906:class_export_put()) final put ffff9ac7bf765000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1783969476.490734:0:12811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1783969476.490741:0:12811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783969476.490746:0:12811:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1783969476.490749:0:12811:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9ac7ba7319c0) has no exports 00000020:00000080:2.0:1783969476.490755:0:12811:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faabc7 00000020:00000080:2.0:1783969476.490759:0:12811:0:(genops.c:906:class_export_put()) final put ffff9ac7c19c6000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1783969476.491898:0:12811:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1783969476.491904:0:12811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783969476.491907:0:12811:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1783969476.491912:0:12811:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783969476.491914:0:12811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783969476.491942:0:12811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783969476.491949:0:12811:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783969476.491977:0:12811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783969476.491981:0:12811:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783969476.491986:0:12811:0:(genops.c:906:class_export_put()) final put ffff9ac7a70ec000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783969476.492001:0:12811:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7a70ec000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1783969476.492008:0:12811:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783969476.493160:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7c19c2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783969476.493174:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ac7c19c5000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783969476.493190:0:8:0:(genops.c:906:class_export_put()) final put ffff9ac682864800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783969476.493193:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac682864800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1783969476.493197:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783969476.493275:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7bf765000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783969476.493281:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7c19c6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783969476.493285:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ac7c19c0000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783969476.493289:0:8:0:(genops.c:906:class_export_put()) final put ffff9ac7a70ec800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783969476.493291:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7a70ec800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1783969476.493294:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783969476.494249:0:12811:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faaa8c 00000020:00000080:2.0:1783969476.494257:0:12811:0:(genops.c:906:class_export_put()) final put ffff9ac7ba73d000/lustre-MDD0000_UUID 00000020:01000000:2.0:1783969476.494278:0:12811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1783969476.494283:0:12811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783969476.494293:0:12811:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783969476.494297:0:12811:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9ac7ba734d40) has no exports 00000020:00000080:2.0:1783969476.494320:0:12811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783969476.496896:0:12811:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1783969476.496914:0:12811:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faaa93 00000020:00000080:2.0:1783969476.496924:0:12811:0:(genops.c:906:class_export_put()) final put ffff9ac7ba73c000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783969476.496935:0:12811:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ac783021000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1783969476.496938:0:12811:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac783021000 3 00000020:01000004:2.0:1783969476.496941:0:12811:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ac783021000 from lustre-MDT0000 00000020:00000080:2.0:1783969476.496965:0:12811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783969476.496974:0:12811:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1783969476.496977:0:12811:0:(genops.c:906:class_export_put()) final put ffff9ac782f7b000/lustre-MDT0000_UUID 00000020:00000080:2.0:1783969476.496980:0:12811:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac782f7b000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1783969476.496990:0:12811:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1783969476.498474:0:12811:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1783969476.498483:0:12811:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1783969476.498488:0:12811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1783969476.498492:0:12811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783969476.498497:0:12811:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783969476.498505:0:12811:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9ac7910fd000 c893ad09-f78f-4711-bea5-6489668294ed 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783969476.498512:0:12811:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9ac786198000) has exports, disconnecting them 00000020:00080000:2.0:1783969476.498516:0:12811:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9ac7910fd000), last request at 1783969264 00000020:00000080:2.0:1783969476.498530:0:12811:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faaa31 00000020:00010000:2.0:1783969476.498535:0:12811:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9ac7910fd000: total 2 00000100:00080000:2.0:1783969476.498539:0:12811:0:(import.c:65:import_set_state_nolock()) ffff9ac78c7b0000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1783969476.498562:0:12811:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ac7910fd000): rc 0 00000020:00080000:2.0:1783969476.498579:0:12811:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9ac786198000) has no exports 00000020:00010000:0.0:1783969476.498581:0:5782:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9ac7910fd000: total 2 00010000:00010000:0.0:1783969476.498616:0:5782:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9ac7910fd000, canceled 0 locks, left on hash table 8. 00000100:00100000:2.0:1783969476.498632:0:5788:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9ac788794a00:5788] 2 exiting: rc = 0 00010000:00010000:0.0:1783969476.498643:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7bfb93400/0xbacf56d076faad41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbacf56d076faad3a expref: 9 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.498666:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7bfb93200/0xbacf56d076faad33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbacf56d076faad2c expref: 8 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.498676:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7bfb93a00/0xbacf56d076faad4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbacf56d076faad48 expref: 7 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.498686:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac783de7000/0xbacf56d076faad5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbacf56d076faad56 expref: 6 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.498696:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac781496a00/0xbacf56d076faaf86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbacf56d076faaf7f expref: 5 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.498717:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac783de6e00/0xbacf56d076faab3b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbacf56d076faab34 expref: 4 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.498731:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac781496800/0xbacf56d076faaf78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbacf56d076faaf71 expref: 3 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.498742:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7bfb92800/0xbacf56d076faad87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbacf56d076faad80 expref: 2 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969476.498753:0:5782:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9ac7910fd000, canceled 8 locks, left on hash table 0. 00000100:00100000:2.0:1783969476.498760:0:5786:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9ac788794800:5786] 0 exiting: rc = 1 00000020:00000080:0.0:1783969476.498765:0:5782:0:(genops.c:906:class_export_put()) final put ffff9ac7910fd000/c893ad09-f78f-4711-bea5-6489668294ed 00010000:00010000:0.0:1783969476.498772:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969476.498774:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969476.498776:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969476.498814:0:5787:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9ac7918a9a00:5787] 1 exiting: rc = 0 00000020:00000080:1.0:1783969476.498849:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7ba73d000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1783969476.498855:0:8:0:(genops.c:906:class_export_put()) final put ffff9ac7a70ed800/lustre-MDD0000_UUID 00000020:00000080:1.0:1783969476.498872:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7a70ed800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1783969476.498877:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1783969476.499088:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7ba73c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783969476.499092:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7910fd000/c893ad09-f78f-4711-bea5-6489668294ed for MGS 00000020:00000080:1.0:1783969476.499126:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ac78c7b0000 for MGS 00000100:00100000:2.0:1783969476.500459:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500469:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500475:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500480:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500486:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500491:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500497:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500501:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500506:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500511:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500516:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500521:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500525:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500530:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500535:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500539:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500544:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500549:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500554:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500560:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500564:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500571:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500576:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500582:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500588:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500593:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500599:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500604:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500609:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500613:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500618:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500637:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500641:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500646:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500651:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500655:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500660:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500665:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500670:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500674:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500680:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500685:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500690:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500695:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500700:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500716:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500723:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500728:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500732:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500737:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500743:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500747:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500751:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500756:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500761:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500766:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500771:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500777:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500782:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500787:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500792:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500797:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500802:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.500807:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1783969476.501616:0:12811:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783969476.501621:0:12811:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1783969476.509788:0:12811:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9ac7860c82a0 - data ffff9ac7a6fc6af8/ffff9ac7ba632800 00000020:01000000:2.0:1783969476.509958:0:12811:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9ac791c76de0 - data ffff9ac79eee4000/ffff9ac78873a000 00000020:00000080:2.0:1783969476.510447:0:12811:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faaa15 00000020:00000080:2.0:1783969476.510455:0:12811:0:(genops.c:906:class_export_put()) final put ffff9ac7885dd800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783969476.510474:0:12811:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ac783021000 from MGS, refs=2 00000020:01000004:2.0:1783969476.510478:0:12811:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac783021000 2 00000020:01000004:2.0:1783969476.510481:0:12811:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ac783021000 from MGS 00000020:00000080:2.0:1783969476.510501:0:12811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783969476.510507:0:12811:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1783969476.510510:0:12811:0:(genops.c:906:class_export_put()) final put ffff9ac7910fa800/MGS 00000020:00000080:2.0:1783969476.510513:0:12811:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7910fa800/MGS for MGS 00000020:01000000:2.0:1783969476.510519:0:12811:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:0.0:1783969476.510533:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7885dd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1783969476.510570:0:12811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1783969476.510574:0:12811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783969476.510579:0:12811:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783969476.510585:0:12811:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9ac7c04f5000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783969476.510591:0:12811:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9ac7ba733380) has exports, disconnecting them 00000020:00080000:2.0:1783969476.510594:0:12811:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9ac7c04f5000), last request at 1783969265 00000020:00000080:2.0:1783969476.510600:0:12811:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faaae0 00000020:00080000:2.0:1783969476.510610:0:12811:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ac7c04f5000): rc 0 00000020:00000080:2.0:1783969476.510614:0:12811:0:(genops.c:906:class_export_put()) final put ffff9ac7c04f5000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783969476.510715:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7c04f5000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1783969476.543981:0:12811:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1783969476.543990:0:12811:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783969476.543994:0:12811:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783969476.544001:0:12811:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783969476.544138:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ac7a70ea800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783969476.544238:0:12811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783969476.544246:0:12811:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1783969476.544251:0:12811:0:(genops.c:906:class_export_put()) final put ffff9ac7ba73a800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1783969476.544255:0:12811:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7ba73a800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1783969476.544271:0:12811:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1783969476.544325:0:12811:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac783021000 1 00000020:00000080:0.0:1783969476.544331:0:12811:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faaa07 00000020:00000080:0.0:1783969476.544337:0:12811:0:(genops.c:906:class_export_put()) final put ffff9ac7910ff800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1783969476.544351:0:12811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1783969476.544355:0:12811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783969476.544358:0:12811:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783969476.544362:0:12811:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9ac7882b0000) has no exports 00000020:00000080:1.0:1783969476.545147:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7910ff800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783969476.600651:0:12811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783969476.600665:0:12811:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1783969476.600670:0:12811:0:(genops.c:906:class_export_put()) final put ffff9ac78c7b2800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783969476.600674:0:12811:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac78c7b2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1783969476.600682:0:12811:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1783969476.600846:0:12811:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ac783020800 00000020:01000000:0.0:1783969476.600886:0:12811:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1783969476.600890:0:12811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783969476.600894:0:12811:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783969476.600897:0:12811:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9ac7882b4d40) has no exports 00000100:00100000:0.0:1783969476.601053:0:5794:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9ac7919bcc00:5794] 1 exiting: rc = 0 00000100:00100000:2.0:1783969476.601961:0:10288:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9ac7bf76ec00:10288] 4 exiting: rc = 0 00000100:00100000:2.0:1783969476.602060:0:5795:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9ac798c57200:5795] 2 exiting: rc = 0 00000100:00100000:3.0:1783969476.604414:0:6618:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9ac7bf7b7200:6618] 3 exiting: rc = 0 00000100:00100000:1.0:1783969476.606379:0:5793:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9ac798c57800:5793] 0 exiting: rc = 1 00000100:00100000:0.0:1783969476.607658:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.607669:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.607675:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.607682:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.607700:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.607970:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.607978:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.607983:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.607988:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.607995:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608000:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608007:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608012:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608017:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608023:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608027:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608032:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608397:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608403:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608408:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608413:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608417:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608422:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608428:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608433:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608438:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608444:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608450:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608456:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608461:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608467:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608472:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608477:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608482:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608487:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608492:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608497:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608503:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608508:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608522:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608527:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608533:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608538:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608543:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608549:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608555:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608560:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608566:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608571:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608577:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608582:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608586:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608591:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608597:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608602:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608608:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608613:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608617:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608622:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608626:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608631:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608635:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608640:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.608644:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.624886:0:5797:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9ac782e2e200:5797] 1 exiting: rc = 0 00000100:00100000:2.0:1783969476.629768:0:5796:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9ac782e2fc00:5796] 0 exiting: rc = 1 00000100:00100000:1.0:1783969476.630107:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630118:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630127:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630136:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630144:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630152:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630161:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630169:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630178:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630186:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630196:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630204:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630213:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630221:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630230:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630241:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630252:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630259:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630264:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630268:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630281:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630286:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630291:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630296:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630302:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630311:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630319:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630326:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630334:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630341:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630349:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630355:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630363:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630371:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630379:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630399:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630405:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630412:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630420:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630427:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630436:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630443:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630450:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630457:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630464:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630474:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630486:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630493:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630512:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630517:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630522:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630528:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630533:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630539:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630544:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630549:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630555:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630560:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630566:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630572:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630577:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630582:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630587:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.630593:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.631125:0:5799:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9ac7877d4800:5799] 1 exiting: rc = 0 00000100:00100000:0.0:1783969476.631196:0:5798:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9ac7919be400:5798] 0 exiting: rc = 1 00000100:00100000:1.0:1783969476.632689:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.632701:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.632728:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.632751:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.632763:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.632771:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.632794:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.632802:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.635047:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.635086:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.635092:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.635099:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.635104:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.635110:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.635115:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.635144:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636146:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636396:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636405:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636413:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636422:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636430:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636439:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636487:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636567:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636576:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636582:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636614:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636623:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636632:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636640:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636649:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636656:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636663:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636672:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636679:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636687:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636694:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636712:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636745:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636754:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636784:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636792:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636799:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.636808:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.638956:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.638972:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.638981:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.638990:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.638998:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.639006:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.639040:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.639049:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.639992:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.640007:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.640015:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.640023:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.640032:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.640040:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.640048:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.640921:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.640937:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.640947:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969476.640968:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.694896:0:5800:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9ac782e2f800:5800] 0 exiting: rc = 1 00000100:00100000:3.0:1783969476.695098:0:5801:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9ac782e2ea00:5801] 1 exiting: rc = 0 00000100:00100000:0.0:1783969476.697430:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697440:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697444:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697449:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697454:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697459:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697464:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697470:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697489:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697495:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697500:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697506:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697511:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697516:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697522:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697527:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697533:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697538:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697543:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697548:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697553:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697558:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697563:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697569:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697574:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697579:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697584:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697590:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697595:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697600:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697605:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697610:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697615:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697620:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697624:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697629:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697634:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697640:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697645:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697651:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697656:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697661:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697666:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697679:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697684:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697689:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697694:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697698:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697714:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697720:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697725:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697731:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697736:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697742:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697747:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697752:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697757:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697761:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697766:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697771:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697775:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697779:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697784:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969476.697789:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.700421:0:5802:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9ac782e2ec00:5802] 0 exiting: rc = 1 00000100:00100000:3.0:1783969476.700579:0:5803:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9ac785663c00:5803] 1 exiting: rc = 0 00000100:00100000:2.0:1783969476.700699:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700717:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700722:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700728:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700734:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700756:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700761:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700765:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700770:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700774:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700779:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700855:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700893:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700898:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700903:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700908:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700913:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700917:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700922:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700927:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700931:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700936:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700941:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700946:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700950:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700955:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700959:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700964:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700969:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700974:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700978:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700983:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700988:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700993:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.700999:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701003:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701009:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701013:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701019:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701024:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701038:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701043:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701048:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701053:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701058:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701062:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701067:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701073:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701077:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701082:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701088:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701092:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701097:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701102:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701106:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701111:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701115:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701120:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701125:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701130:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701135:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701139:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701144:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701151:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.701539:0:5804:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9ac785662000:5804] 0 exiting: rc = 1 00000100:00100000:3.0:1783969476.701591:0:5805:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9ac785662600:5805] 1 exiting: rc = 0 00000100:00100000:2.0:1783969476.701676:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701682:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701688:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701693:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701698:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701712:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701717:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701722:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701727:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701732:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701737:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701751:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701756:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701761:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701766:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701771:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701776:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701781:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701786:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701791:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701796:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701801:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701807:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701812:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701816:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701821:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701825:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701830:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701834:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701839:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701844:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701849:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701854:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701886:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701894:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701901:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701906:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701916:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701922:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701928:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701932:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701938:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701943:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701952:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701957:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701961:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701973:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701978:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701983:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701988:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701993:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.701998:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.702003:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.702008:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.702012:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.702017:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.702022:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.702027:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.702033:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.702038:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.702042:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.702047:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.702052:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783969476.702057:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.702639:0:5806:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9ac7919bd800:5806] 0 exiting: rc = 1 00000100:00100000:3.0:1783969476.702810:0:5807:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9ac786053800:5807] 1 exiting: rc = 0 00000100:00100000:2.0:1783969476.703241:0:5808:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9ac7a70e5e00:5808] 2 exiting: rc = 0 00000100:00100000:3.0:1783969476.703549:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703557:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703562:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703567:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703573:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703578:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703584:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703598:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703604:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703612:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703618:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703623:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703629:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703635:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703641:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703647:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703654:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703672:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703679:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703685:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703690:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703696:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703712:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703719:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703724:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703730:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703736:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703742:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703747:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703752:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703758:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703764:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703769:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703775:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703785:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703790:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703795:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703801:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703806:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703812:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703818:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703842:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703855:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703892:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703899:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703905:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703912:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703918:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703924:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703929:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703935:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703941:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703946:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703951:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703957:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703962:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703968:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703973:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703978:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703983:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703988:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703993:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.703998:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969476.704011:0:12811:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1783969476.708122:0:12811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783969476.708135:0:12811:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1783969476.708140:0:12811:0:(genops.c:906:class_export_put()) final put ffff9ac782f78800/MDS_uuid 00000020:00000080:3.0:1783969476.708145:0:12811:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac782f78800/MDS_uuid for MDS 00000020:01000000:3.0:1783969476.708150:0:12811:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1783969476.708282:0:12811:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1783969477.157117:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969477.734638:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783969477.734712:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969477.734731:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280601472:0@lo:400:kworker.0 00000400:00000100:1.0:1783969477.734785:0:3285:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870627280601472 offset 0 length 224: 4 00000100:00100000:3.0:1783969477.739624:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280601344:0@lo:400:kworker.0 00000400:00000100:3.0:1783969477.739680:0:3286:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870627280601344 offset 0 length 224: 4 00000100:00100000:0.0:1783969477.740083:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1870627280601600:0@lo:400:kworker.0 00000400:00000100:0.0:1783969477.740228:0:3287:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870627280601600 offset 0 length 224: 4 00010000:00010000:1.0:1783969478.189357:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969479.206113:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783969479.657978:0:12961:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783969479.677100:0:12961:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1783969479.677146:0:12961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de6200/0xbacf56d076faad48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad4f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969479.677160:0:12961:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de6200/0xbacf56d076faad48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faad4f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969479.677167:0:12961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de6200/0xbacf56d076faad48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbacf56d076faad4f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969479.677187:0:12961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9ac783de6200/0xbacf56d076faad48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbacf56d076faad4f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969479.677211:0:12961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783969479.677216:0:12961:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783969479.677240:0:12961:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783969479.677251:0:12961:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ac7bf6b3480 x1870627280601472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969493 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969479.677277:0:12961:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783969479.677283:0:12961:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783969479.677305:0:12961:0:(import.c:65:import_set_state_nolock()) ffff9ac7bfa6a800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1783969479.677368:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969479.677375:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac783de6200/0xbacf56d076faad48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xbacf56d076faad4f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969479.677383:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6200 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:1.0:1783969479.677392:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac783de6200/0xbacf56d076faad48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xbacf56d076faad4f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969479.677400:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac783de6200/0xbacf56d076faad48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xbacf56d076faad4f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783969479.677407:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac783de6200/0xbacf56d076faad48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xbacf56d076faad4f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969479.677413:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783969479.677416:0:5781:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783969479.677418:0:5781:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783969479.677443:0:5781:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac783de6200/0xbacf56d076faad48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbacf56d076faad4f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969479.677449:0:5781:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783969479.677478:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac783de6200/0xbacf56d076faad48 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbacf56d076faad4f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969479.677486:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac783de6200/0xbacf56d076faad48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbacf56d076faad4f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969479.677498:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969479.677500:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969479.677502:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969479.677516:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3284:1870627280601728:0@lo:39:umount.0 00000400:00000100:1.0:1783969479.677584:0:3284:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870627280601728 offset 0 length 224: 4 00000100:00100000:1.0:1783969479.677644:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969479.677652:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280601856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783969479.677701:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969479.677739:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280601472:0@lo:400:kworker.0 00000100:00100000:1.0:1783969479.677754:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280601856 00000100:00100000:1.0:1783969479.677761:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280601856 00000100:00100000:1.0:1783969479.677804:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783969479.677812:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7860bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3287:x1870627280601856:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783969479.677819:0:5780:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783969479 with bad export cookie 13461073264583027249 00000100:00100000:1.0:1783969479.692123:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7860bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3287:x1870627280601856:12345-0@lo:103:ldlm_bl.0 Request processed in 14300us (14411us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783969479.692137:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1783969479.692239:0:3287:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.139@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783969479.692245:0:3287:0:(import.c:65:import_set_state_nolock()) ffff9ac7910f9000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1783969479.692250:0:3287:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.139@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1783969479.706200:0:3287:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.139@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1783969479.706206:0:3287:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1783969479.706215:0:3287:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ac7bf6b0700 x1870627280601344/t0(0) o400->MGC192.168.203.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783969493 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969479.706290:0:3287:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ac7c1bbca80 x1870627280601856/t0(0) o103->MGC192.168.203.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783969495 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1783969479.706298:0:3287:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1783969479.706301:0:3287:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1783969479.706319:0:3287:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1783969479.706322:0:3287:0:(import.c:65:import_set_state_nolock()) ffff9ac7910f9000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783969479.706327:0:3287:0:(import.c:510:import_select_connection()) MGC192.168.203.139@tcp: connect to NID 0@lo last attempt 121 00000100:00080000:2.0:1783969479.706336:0:3287:0:(import.c:624:import_select_connection()) MGC192.168.203.139@tcp: import ffff9ac7910f9000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1783969479.706362:0:3287:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac7c1be9880 x1870627280601984/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783969479.706396:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c893ad09-f78f-4711-bea5-6489668294ed:3287:1870627280601856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783969479.706507:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c893ad09-f78f-4711-bea5-6489668294ed:3284:1870627280601984:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1783969479.706550:0:3284:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870627280601984 offset 0 length 520: 4 00000100:00100000:3.0:1783969479.708767:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c893ad09-f78f-4711-bea5-6489668294ed:3286:1870627280601344:0@lo:400:kworker.0 00010000:00010000:1.0:1783969480.229127:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783969480.338522:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783969480.338531:0:6622:0:(genops.c:906:class_export_put()) final put ffff9ac7c19c4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783969480.338606:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7c19c4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1783969480.338652:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ac7c19c5800 for lustre-OST0000 00000001:00100000:3.0:1783969480.887075:0:7494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783969480.887097:0:7494:0:(genops.c:906:class_export_put()) final put ffff9ac7ba65b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783969480.887280:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7ba65b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1783969480.887331:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ac7ba65a800 for lustre-OST0001 00010000:00010000:0.0:1783969481.257818:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969482.277155:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783969482.853604:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c893ad09-f78f-4711-bea5-6489668294ed->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783969482.853613:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) c893ad09-f78f-4711-bea5-6489668294ed->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783969482.853722:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1870627280602112:0@lo:400:kworker.0 00000400:00000100:3.0:1783969482.853779:0:3285:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870627280602112 offset 0 length 224: 4 00010000:00010000:1.0:1783969483.301085:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969484.325344:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783969484.901984:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c893ad09-f78f-4711-bea5-6489668294ed->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783969484.901994:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) c893ad09-f78f-4711-bea5-6489668294ed->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783969484.902115:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1870627280602240:0@lo:400:kworker.0 00000400:00000100:0.0:1783969484.902173:0:3286:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870627280602240 offset 0 length 224: 4 00010000:00010000:1.0:1783969485.349324:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969486.373067:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969487.397116:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969488.421053:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969489.445118:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783969490.021277:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c893ad09-f78f-4711-bea5-6489668294ed->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783969490.021288:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c893ad09-f78f-4711-bea5-6489668294ed->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783969490.021699:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783969490.021719:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1870627280602368:0@lo:400:kworker.0 00000400:00000100:1.0:1783969490.021773:0:3288:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870627280602368 offset 0 length 224: 4 00000100:00100000:3.0:1783969490.022096:0:3284:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783969479/real 1783969479] req@ffff9ac7c1be9880 x1870627280601984/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783969489 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969490.022117:0:3284:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ac7c1be9880 x1870627280601984/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783969489 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969490.022127:0:3284:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783969479/real 1783969479] req@ffff9ac7bf6b1880 x1870627280601728/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783969489 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969490.022138:0:3284:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ac7bf6b1880 x1870627280601728/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783969489 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783969490.022150:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9ac7910f9000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783969490.022166:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1783969490.022170:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c893ad09-f78f-4711-bea5-6489668294ed:3284:1870627280601984:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1783969490.022176:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9ac7bfa6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783969490.022191:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3284:1870627280601728:0@lo:39:umount.0 00000100:00080000:0.0:1783969490.022258:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c893ad09-f78f-4711-bea5-6489668294ed->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783969490.022262:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783969490.022265:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ac7910f9000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783969490.022269:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.139@tcp: connect to NID 0@lo last attempt 336 00000100:00080000:0.0:1783969490.022274:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.139@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783969490.022280:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.139@tcp: import ffff9ac7910f9000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783969490.022299:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac7bf6b3b80 x1870627280602496/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783969490.022585:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c893ad09-f78f-4711-bea5-6489668294ed:3284:1870627280602496:0@lo:250:kworker.0 00000400:00000100:3.0:1783969490.022614:0:3284:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870627280602496 offset 0 length 520: 4 00000100:00080000:1.0:1783969490.023335:0:12961:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783969490.023341:0:12961:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783969490.023348:0:12961:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783969490.027607:0:12961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faad56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad5d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969490.028790:0:12961:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faad56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faad5d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969490.028800:0:12961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faad56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbacf56d076faad5d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969490.028806:0:12961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faad56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbacf56d076faad5d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969490.028917:0:12961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969490.028933:0:12961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faaf7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaf86 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969490.028940:0:12961:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faaf7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faaf86 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969490.028946:0:12961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faaf7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbacf56d076faaf86 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969490.028951:0:12961:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faaf7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbacf56d076faaf86 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.036155:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783969490.036171:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faad56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbacf56d076faad5d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.036183:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac781497800 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:0.0:1783969490.036187:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faad56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbacf56d076faad5d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.036198:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faad56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xbacf56d076faad5d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969490.036205:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faad56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xbacf56d076faad5d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969490.036211:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783969490.036214:0:5782:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1783969490.036228:0:5782:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ac7910f9000 00010000:00010000:0.0:1783969490.036232:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faad56 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xbacf56d076faad5d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.036248:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac781497800/0xbacf56d076faad56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xbacf56d076faad5d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.036269:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969490.036272:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faaf7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbacf56d076faaf86 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.036279:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c21e3a00 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:0.0:1783969490.036281:0:5782:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faaf7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbacf56d076faaf86 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.036304:0:5782:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faaf7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbacf56d076faaf86 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969490.036311:0:5782:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faaf7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbacf56d076faaf86 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969490.036316:0:5782:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783969490.036318:0:5782:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1783969490.036334:0:5782:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ac7910f9000 00010000:00010000:0.0:1783969490.036337:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faaf7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbacf56d076faaf86 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969490.036345:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969490.036346:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969490.036349:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969490.045768:0:12961:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783969490.045783:0:12961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3a00/0xbacf56d076faaf7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbacf56d076faaf86 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969490.045805:0:12961:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1783969490.045813:0:12961:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1783969490.045815:0:12961:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1783969490.045885:0:12961:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1783969490.045889:0:12961:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1783969490.045897:0:12961:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783969490.045902:0:12961:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783969490.045906:0:12961:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9ac78619b380) has no exports 00000020:00080000:1.0:1783969490.045943:0:12961:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9ac78619b380) has no exports 00010000:00010000:3.0:1783969490.047345:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1783969490.054856:0:12961:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9ac7860f4a80 - data ffff9ac79eff56c0/ffff9ac7bfa43800 00000020:01000000:1.0:1783969490.055025:0:12961:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9ac791ab9f60 - data ffff9ac79ef6e438/ffff9ac7860d6400 00100000:10000000:1.0:1783969490.066097:0:12961:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1783969490.127166:0:12961:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faab57 00000020:00000080:1.0:1783969490.127175:0:12961:0:(genops.c:906:class_export_put()) final put ffff9ac7bf7ac800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1783969490.127193:0:12961:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ac7ba5f7000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1783969490.127197:0:12961:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac7ba5f7000 2 00000020:01000004:1.0:1783969490.127200:0:12961:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ac7ba5f7000 from lustre-OST0000 00000020:00000080:1.0:1783969490.127222:0:12961:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783969490.127231:0:12961:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1783969490.127233:0:12961:0:(genops.c:906:class_export_put()) final put ffff9ac7bf7ad000/lustre-OST0000_UUID 00000020:00000080:1.0:1783969490.127236:0:12961:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7bf7ad000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1783969490.127242:0:12961:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1783969490.127292:0:12961:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1783969490.127296:0:12961:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1783969490.127300:0:12961:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783969490.127304:0:12961:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783969490.127310:0:12961:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9ac7bfa6b800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783969490.127316:0:12961:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9ac7b6433380) has exports, disconnecting them 00000020:00080000:1.0:1783969490.127320:0:12961:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9ac7bfa6b800), last request at 1783969281 00000020:00000080:1.0:1783969490.127323:0:12961:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faab81 00000020:00080000:1.0:1783969490.127335:0:12961:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ac7bfa6b800): rc 0 00000020:00000080:1.0:1783969490.127344:0:12961:0:(genops.c:906:class_export_put()) final put ffff9ac7bfa6b800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1783969490.127385:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7bf7ac800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1783969490.127401:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7bfa6b800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1783969490.134208:0:12961:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1783969490.134217:0:12961:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783969490.134222:0:12961:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783969490.134230:0:12961:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783969490.134408:0:12961:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783969490.134418:0:12961:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1783969490.134440:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ac7bfa6a800 for lustre-MDT0000-lwp-OST0000 00000020:01000004:0.0:1783969490.134440:0:12961:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac7ba5f7000 1 00000020:00000080:0.0:1783969490.134450:0:12961:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faab11 00000020:00000080:2.0:1783969490.134454:0:8:0:(genops.c:906:class_export_put()) final put ffff9ac7bfa6e800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1783969490.134459:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7bfa6e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1783969490.134459:0:12961:0:(genops.c:906:class_export_put()) final put ffff9ac786168800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1783969490.134472:0:12961:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:01000000:2.0:1783969490.134474:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1783969490.134483:0:12961:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783969490.134489:0:12961:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783969490.134507:0:12961:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9ac7917f0000) has no exports 00000020:00000080:2.0:1783969490.134546:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac786168800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1783969490.198677:0:12961:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783969490.198691:0:12961:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1783969490.198696:0:12961:0:(genops.c:906:class_export_put()) final put ffff9ac7ba5f2000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1783969490.198700:0:12961:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7ba5f2000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1783969490.198710:0:12961:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1783969490.200733:0:12961:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ac7ba5f5800 00000020:02000400:0.0:1783969490.200785:0:12961:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1783969490.470005:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969491.495325:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969492.522058:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783969492.828487:0:13116:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783969492.837719:0:13116:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1783969492.837794:0:13116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faad2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad33 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969492.837807:0:13116:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faad2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faad33 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969492.837814:0:13116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faad2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbacf56d076faad33 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969492.837821:0:13116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faad2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbacf56d076faad33 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969492.837847:0:13116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783969492.837852:0:13116:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783969492.837895:0:13116:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783969492.837907:0:13116:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ac7bf6b3800 x1870627280601600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969493 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969492.837923:0:13116:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ac7c1beaa00 x1870627280602112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969498 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969492.837953:0:13116:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ac785317b80 x1870627280602240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969500 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969492.837964:0:13116:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ac7bf6b2680 x1870627280602368/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969506 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969492.837973:0:13116:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1783969492.838004:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1870627280602240:0@lo:400:kworker.0 00000100:00100000:0.0:1783969492.838038:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1870627280602368:0@lo:400:kworker.0 00000100:00080000:0.0:1783969492.838054:0:13116:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783969492.838075:0:13116:0:(import.c:65:import_set_state_nolock()) ffff9ac7ba658800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1783969492.838282:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3284:1870627280602624:0@lo:39:umount.0 00000400:00000100:3.0:1783969492.838332:0:3284:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870627280602624 offset 0 length 224: 4 00000100:00100000:3.0:1783969492.838501:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3285:1870627280602112:0@lo:400:kworker.0 00010000:00010000:3.0:1783969492.838532:0:8303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969492.838539:0:8303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faad2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbacf56d076faad33 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969492.838548:0:8303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c21e2a00 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:3.0:1783969492.838551:0:8303:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faad2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbacf56d076faad33 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969492.838561:0:8303:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faad2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbacf56d076faad33 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969492.838568:0:8303:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faad2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbacf56d076faad33 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969492.838574:0:8303:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783969492.838577:0:8303:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783969492.838579:0:8303:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783969492.838593:0:8303:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ac7910f9000 00010000:00010000:3.0:1783969492.838596:0:8303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faad2c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbacf56d076faad33 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969492.838617:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e2a00/0xbacf56d076faad2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbacf56d076faad33 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969492.838628:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969492.838630:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969492.838631:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969492.839364:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1870627280601600:0@lo:400:kworker.0 00010000:00010000:0.0:1783969493.541170:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969494.565084:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783969495.141411:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c893ad09-f78f-4711-bea5-6489668294ed->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783969495.141422:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c893ad09-f78f-4711-bea5-6489668294ed->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1783969495.589116:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969496.613241:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969497.638767:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969498.661067:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969499.685080:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783969500.261104:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c893ad09-f78f-4711-bea5-6489668294ed->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783969500.261113:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c893ad09-f78f-4711-bea5-6489668294ed->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1783969500.709062:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969501.733201:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969502.757622:0:5782:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783969503.017098:0:3284:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783969492/real 1783969492] req@ffff9ac7bf6b2680 x1870627280602624/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783969502 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969503.017128:0:3284:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ac7bf6b2680 x1870627280602624/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783969502 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783969503.017145:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9ac7ba658800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783969503.017168:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3284:1870627280602624:0@lo:39:umount.0 00000100:00080000:2.0:1783969503.017252:0:13116:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783969503.017256:0:13116:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783969503.017260:0:13116:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1783969503.018111:0:13116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de7200/0xbacf56d076faad3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faad41 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969503.018124:0:13116:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de7200/0xbacf56d076faad3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faad41 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969503.018132:0:13116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de7200/0xbacf56d076faad3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbacf56d076faad41 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969503.018139:0:13116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9ac783de7200/0xbacf56d076faad3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbacf56d076faad41 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969503.018165:0:13116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783969503.018171:0:13116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3e00/0xbacf56d076faaf71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076faaf78 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969503.018178:0:13116:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3e00/0xbacf56d076faaf71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076faaf78 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969503.018185:0:13116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3e00/0xbacf56d076faaf71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbacf56d076faaf78 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969503.018191:0:13116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3e00/0xbacf56d076faaf71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbacf56d076faaf78 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969503.018207:0:13116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1783969503.018212:0:13116:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1783969503.018229:0:13116:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1783969503.018233:0:13116:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1783969503.018237:0:13116:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783969503.018241:0:13116:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783969503.018254:0:13116:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9ac7ba654d40) has no exports 00000020:00080000:2.0:1783969503.018276:0:13116:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9ac7ba654d40) has no exports 00000020:01000000:2.0:1783969503.020023:0:13116:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9ac7860c8420 - data ffff9ac7a6fc6000/ffff9ac7ba630400 00000020:01000000:2.0:1783969503.020141:0:13116:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9ac681d94d80 - data ffff9ac7a4045870/ffff9ac681220000 00010000:00010000:0.0:1783969503.020609:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783969503.020627:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac783de7200/0xbacf56d076faad3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbacf56d076faad41 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969503.020638:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de7200 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:0.0:1783969503.020642:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac783de7200/0xbacf56d076faad3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbacf56d076faad41 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969503.020651:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac783de7200/0xbacf56d076faad3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbacf56d076faad41 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969503.020659:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac783de7200/0xbacf56d076faad3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbacf56d076faad41 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969503.020665:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783969503.020668:0:5781:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1783969503.020670:0:5781:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1783969503.020685:0:5781:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ac7910f9000 00010000:00010000:0.0:1783969503.020689:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac783de7200/0xbacf56d076faad3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbacf56d076faad41 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969503.020696:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac783de7200/0xbacf56d076faad3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbacf56d076faad41 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969503.020707:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969503.020710:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3e00/0xbacf56d076faaf71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbacf56d076faaf78 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969503.020716:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7c21e3e00 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:0.0:1783969503.020718:0:5781:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3e00/0xbacf56d076faaf71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbacf56d076faaf78 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969503.020738:0:5781:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3e00/0xbacf56d076faaf71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbacf56d076faaf78 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969503.020746:0:5781:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3e00/0xbacf56d076faaf71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbacf56d076faaf78 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969503.020751:0:5781:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783969503.020753:0:5781:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1783969503.020754:0:5781:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1783969503.020761:0:5781:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ac7910f9000 00010000:00010000:0.0:1783969503.020764:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3e00/0xbacf56d076faaf71 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xbacf56d076faaf78 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969503.020770:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3e00/0xbacf56d076faaf71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xbacf56d076faaf78 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969503.020782:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969503.020783:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969503.020785:0:5781:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969503.020953:0:8303:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1783969503.028659:0:13116:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1783969503.056200:0:13116:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faac30 00000020:00000080:3.0:1783969503.056209:0:13116:0:(genops.c:906:class_export_put()) final put ffff9ac7ba65f000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1783969503.056229:0:13116:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ac7bf7a8800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1783969503.056242:0:13116:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac7bf7a8800 2 00000020:01000004:3.0:1783969503.056245:0:13116:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ac7bf7a8800 from lustre-OST0001 00000020:00000080:3.0:1783969503.056268:0:13116:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783969503.056287:0:13116:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1783969503.056290:0:13116:0:(genops.c:906:class_export_put()) final put ffff9ac7bfa6c000/lustre-OST0001_UUID 00000020:00000080:3.0:1783969503.056293:0:13116:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7bfa6c000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1783969503.056298:0:13116:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1783969503.056386:0:13116:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import c893ad09-f78f-4711-bea5-6489668294ed->MGS 00010000:00010000:3.0:1783969503.056400:0:13116:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac780030a00/0xbacf56d076faab34 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbacf56d076faab3b expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969503.056412:0:13116:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac780030a00/0xbacf56d076faab34 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbacf56d076faab3b expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969503.056419:0:13116:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1783969503.056422:0:13116:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1783969503.056425:0:13116:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1783969503.056438:0:13116:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ac7910f9000 00010000:00010000:3.0:1783969503.056441:0:13116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac780030a00/0xbacf56d076faab34 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbacf56d076faab3b expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969503.056456:0:13116:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3600/0xbacf56d076faad80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbacf56d076faad87 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969503.056462:0:13116:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3600/0xbacf56d076faad80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbacf56d076faad87 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969503.056476:0:13116:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783969503.056479:0:13116:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1783969503.056480:0:13116:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1783969503.056489:0:13116:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ac7910f9000 00010000:00010000:3.0:1783969503.056492:0:13116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac7c21e3600/0xbacf56d076faad80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbacf56d076faad87 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783969503.056508:0:13116:0:(import.c:65:import_set_state_nolock()) ffff9ac7910f9000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1783969503.056512:0:13116:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1783969503.056514:0:13116:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1783969503.056515:0:13116:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1783969503.056519:0:13116:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1783969503.056528:0:13116:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ac7bf6b3b80 x1870627280602496/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783969505 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1783969503.056600:0:13116:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1783969503.056603:0:13116:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000020:00000080:0.0:1783969503.056886:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7ba65f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1783969503.057075:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c893ad09-f78f-4711-bea5-6489668294ed:3284:1870627280602496:0@lo:250:kworker.0 10000000:01000000:3.0:1783969503.057220:0:13116:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1783969503.057234:0:13116:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faaa23 00000020:00000080:3.0:1783969503.057239:0:13116:0:(genops.c:906:class_export_put()) final put ffff9ac782f7f000/c893ad09-f78f-4711-bea5-6489668294ed 00000020:01000000:3.0:1783969503.057250:0:13116:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.139@tcp (flags='') 00000020:00000080:3.0:1783969503.057254:0:13116:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783969503.057259:0:13116:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.139@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783969503.057262:0:13116:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9ac7917f19c0) has no exports 00000020:00000080:0.0:1783969503.057342:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac782f7f000/c893ad09-f78f-4711-bea5-6489668294ed for MGC192.168.203.139@tcp 10000000:01000000:3.0:1783969503.058168:0:5790:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1783969503.058363:0:13116:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.139@tcp: client import never connected 00000100:00080000:0.0:1783969503.058367:0:13116:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1783969503.058370:0:13116:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1783969503.058372:0:13116:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1783969503.058375:0:13116:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1783969503.058423:0:13116:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783969503.058429:0:13116:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.139@tcp (uuid c893ad09-f78f-4711-bea5-6489668294ed) 00000020:01000000:0.0:1783969503.058436:0:13116:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1783969503.058449:0:13116:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783969503.058453:0:13116:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783969503.058458:0:13116:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9ac7ba659800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783969503.058463:0:13116:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9ac7ba653380) has exports, disconnecting them 00000020:00080000:0.0:1783969503.058467:0:13116:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9ac7ba659800), last request at 1783969299 00000020:00000080:0.0:1783969503.058470:0:13116:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faac5a 00000020:00080000:0.0:1783969503.058483:0:13116:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ac7ba659800): rc 0 00000020:00000080:0.0:1783969503.058487:0:13116:0:(genops.c:906:class_export_put()) final put ffff9ac7ba659800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1783969503.058813:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ac7910f9000 for MGC192.168.203.139@tcp 00000020:00000080:1.0:1783969503.058821:0:8:0:(genops.c:906:class_export_put()) final put ffff9ac791139000/c893ad09-f78f-4711-bea5-6489668294ed 00000020:00000080:1.0:1783969503.058824:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac791139000/c893ad09-f78f-4711-bea5-6489668294ed for MGC192.168.203.139@tcp 00000020:01000000:1.0:1783969503.058835:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.139@tcp (c893ad09-f78f-4711-bea5-6489668294ed) 00000020:00000080:1.0:1783969503.059092:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7ba659800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1783969503.061985:0:13116:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1783969503.061993:0:13116:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783969503.061997:0:13116:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1783969503.062004:0:13116:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783969503.062093:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9ac7ba658800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1783969503.063962:0:5782:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1783969503.064142:0:5781:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1783969503.064378:0:8303:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1783969503.064544:0:5777:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9ac79182aa00:5777] 1 exiting: rc = 0 00000100:00100000:3.0:1783969503.065972:0:5776:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9ac79182a800:5776] 0 exiting: rc = 1 00000100:00100000:0.0:1783969503.073555:0:8302:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9ac7876cec00:8302] 2 exiting: rc = 0 00000100:00100000:3.0:1783969503.073823:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.074309:0:8304:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9ac7ba516800:8304] 3 exiting: rc = 0 00000100:00100000:1.0:1783969503.074371:0:5780:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9ac7860b8e00:5780] 2 exiting: rc = 0 00000100:00100000:3.0:1783969503.076164:0:5779:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9ac786be1200:5779] 1 exiting: rc = 0 00000100:00100000:0.0:1783969503.076442:0:5778:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9ac786b0be00:5778] 0 exiting: rc = 1 00000100:00100000:3.0:1783969503.076570:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076578:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076595:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076600:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076605:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076611:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076616:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076621:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076626:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076630:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076634:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076640:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076644:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076649:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076655:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076660:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076665:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076673:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076678:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076682:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076687:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076692:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076699:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076704:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076720:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076725:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076730:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076736:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076741:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076745:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076750:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076754:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076759:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076763:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076768:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076772:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076777:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076791:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076796:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076802:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076808:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076813:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076818:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076823:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076829:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.076834:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.077016:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.077026:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.077032:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.077037:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.077042:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.077046:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.077051:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.077056:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.077062:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.077067:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.077073:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.077078:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.077083:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.077088:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.077093:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.077097:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.077101:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.077105:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1783969503.078230:0:13116:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783969503.078251:0:13116:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1783969503.078256:0:13116:0:(genops.c:906:class_export_put()) final put ffff9ac7ba65c000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1783969503.078261:0:13116:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7ba65c000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1783969503.078266:0:13116:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1783969503.078427:0:13116:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac7bf7a8800 1 00000020:00000080:3.0:1783969503.078434:0:13116:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbacf56d076faabff 00000020:00000080:3.0:1783969503.078448:0:13116:0:(genops.c:906:class_export_put()) final put ffff9ac7c19c4000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1783969503.078495:0:13116:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1783969503.078501:0:13116:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783969503.078506:0:13116:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783969503.078509:0:13116:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9ac7861999c0) has no exports 00000020:00000080:1.0:1783969503.078574:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7c19c4000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1783969503.112704:0:13116:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783969503.112724:0:13116:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1783969503.112729:0:13116:0:(genops.c:906:class_export_put()) final put ffff9ac7bf7a9000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1783969503.112734:0:13116:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac7bf7a9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1783969503.112744:0:13116:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1783969503.112949:0:13116:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ac7bf7aa000 00000020:01000000:1.0:1783969503.112968:0:13116:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1783969503.112971:0:13116:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783969503.112975:0:13116:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783969503.112979:0:13116:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9ac78619cd40) has no exports 00000020:00000080:1.0:1783969503.113002:0:13116:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783969503.113007:0:13116:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1783969503.113017:0:13116:0:(genops.c:906:class_export_put()) final put ffff9ac78616f000/OSS_uuid 00000020:00000080:1.0:1783969503.113020:0:13116:0:(genops.c:865:class_export_destroy()) destroying export ffff9ac78616f000/OSS_uuid for OSS 00000020:01000000:1.0:1783969503.113023:0:13116:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1783969503.113084:0:6595:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9ac78c710400:6595] 2 exiting: rc = 0 00000100:00100000:1.0:1783969503.113166:0:6593:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9ac7ba3c5800:6593] 0 exiting: rc = 1 00000100:00100000:1.0:1783969503.113203:0:6594:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9ac78c710a00:6594] 1 exiting: rc = 0 00000100:00100000:1.0:1783969503.113234:0:9934:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9ac7a7846200:9934] 3 exiting: rc = 0 00000100:00080000:0.0:1783969503.114368:0:5789:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1783969503.115486:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115502:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115510:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115517:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115524:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115529:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115545:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115552:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115557:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115562:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115568:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115573:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115578:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115583:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115589:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115594:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115599:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115605:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115611:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115617:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115622:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115627:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115632:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115645:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115652:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115657:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115662:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115680:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115685:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115690:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115695:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115700:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115706:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115710:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115715:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115720:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115725:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115730:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115735:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115740:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115745:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115750:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115755:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115759:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115765:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115769:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115774:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115779:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115784:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115789:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115794:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115799:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115803:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115808:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115813:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115817:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115822:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115827:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115832:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115848:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.115855:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.116059:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.116072:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.116077:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.119135:0:6597:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9ac7ba51d600:6597] 1 exiting: rc = 0 00000100:00100000:1.0:1783969503.119563:0:6596:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9ac78c711e00:6596] 0 exiting: rc = 1 00000100:00100000:1.0:1783969503.119619:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119628:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119634:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119641:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119647:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119653:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119659:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119664:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119670:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119675:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119680:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119686:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119691:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119697:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119702:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119719:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119726:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119731:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119735:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119742:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119748:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119754:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119759:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119764:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119770:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119774:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119780:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119785:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119791:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119795:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119800:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119805:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119823:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119828:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119832:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119846:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.119852:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120006:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120015:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120021:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120026:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120034:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120041:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120049:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120054:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120060:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120066:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120071:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120077:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120084:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120089:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120095:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120100:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120106:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120111:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120116:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120121:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120126:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120131:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120137:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120142:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120147:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120153:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.120165:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783969503.122515:0:6599:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9ac7ba516400:6599] 1 exiting: rc = 0 00000100:00100000:0.0:1783969503.122788:0:6598:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9ac791e52c00:6598] 0 exiting: rc = 1 00000100:00100000:1.0:1783969503.123465:0:6600:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9ac7b4da6a00:6600] 2 exiting: rc = 0 00000100:00100000:0.0:1783969503.123577:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123586:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123593:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123600:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123605:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123611:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123618:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123623:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123629:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123635:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123641:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123647:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123652:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123657:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123664:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123685:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123692:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123697:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123702:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123718:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123736:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123742:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123747:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123754:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123759:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123765:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123770:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123776:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123781:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123787:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123794:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123799:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123806:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123811:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123816:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123821:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123828:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123833:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123850:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.123856:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.124010:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.124016:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.124022:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.124028:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.124034:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.124039:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.124045:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.124066:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.124072:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.124079:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.124084:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.124090:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.124096:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.124102:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.124108:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.124123:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.124129:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.124135:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.124141:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.124145:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.124150:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.124155:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.124160:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.124166:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.130502:0:6601:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9ac791681600:6601] 0 exiting: rc = 1 00000100:00100000:3.0:1783969503.130639:0:6602:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9ac791680200:6602] 1 exiting: rc = 0 00000100:00100000:1.0:1783969503.130735:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130742:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130759:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130765:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130770:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130775:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130780:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130785:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130790:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130795:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130801:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130806:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130811:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130816:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130822:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130827:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130832:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130837:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130850:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130855:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130894:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130901:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130906:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130910:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130916:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130921:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130926:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130931:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130936:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130941:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130946:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130950:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130955:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130959:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130964:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130970:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130975:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130988:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130993:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.130998:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.131003:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.131007:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.131012:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.131018:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.131023:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.131028:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.131032:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.131037:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.131042:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.131047:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.131052:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.131057:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.131062:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.131209:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.131214:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.131219:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.131224:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.131228:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.131234:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.131239:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.131244:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.131250:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.131255:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.131260:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783969503.132850:0:6603:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9ac791728200:6603] 0 exiting: rc = 1 00000100:00100000:3.0:1783969503.133173:0:6604:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9ac78b522c00:6604] 1 exiting: rc = 0 00000100:00100000:1.0:1783969503.133262:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133601:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133613:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133619:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133625:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133632:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133637:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133643:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133661:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133667:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133673:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133679:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133685:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133716:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133725:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133731:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133738:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133744:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133749:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133754:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133760:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133766:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133772:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133778:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133784:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133803:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133809:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133815:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133821:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133828:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.133834:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134015:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134024:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134030:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134039:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134044:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134052:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134081:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134089:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134095:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134101:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134107:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134113:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134126:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134131:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134137:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134142:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134148:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134153:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134173:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134180:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134187:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134193:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134201:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134207:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134213:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134220:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134227:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134236:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134242:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134249:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134256:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134264:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783969503.134394:0:13116:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1783969503.145800:0:13116:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1783969520.655697:0:13731:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1783969528.572289:0:14145:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1783969528.572294:0:14145:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1783969528.572485:0:14145:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9ac7c1809000 00000020:01000004:1.0:1783969528.572501:0:14145:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1783969528.572509:0:14145:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1783969528.572522:0:14145:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9ac7b64319c0) 00000020:00000080:1.0:1783969528.572535:0:14145:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1783969528.590783:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1783969528.594133:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1783969528.594672:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 533: rc = 0 00100000:10000000:0.0:1783969528.595119:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1783969528.595191:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 533: rc = 0 00100000:10000000:0.0:1783969528.595439:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 533: rc = 0 00100000:10000000:0.0:1783969528.595538:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 533: rc = 0 00100000:10000000:0.0:1783969528.595750:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 533: rc = 0 00100000:10000000:0.0:1783969528.596079:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 533: rc = 0 00100000:10000000:0.0:1783969528.596494:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 535: rc = 0 00100000:10000000:0.0:1783969528.598780:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 768: rc = 0 00100000:10000000:0.0:1783969528.599089:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 768: rc = 0 00100000:10000000:0.0:1783969528.599821:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 279: rc = 0 00100000:10000000:0.0:1783969528.600434:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 279: rc = 0 00100000:10000000:0.0:1783969528.600774:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 279: rc = 0 00100000:10000000:0.0:1783969528.601200:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 279: rc = 0 00100000:10000000:0.0:1783969528.601596:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 279: rc = 0 00100000:10000000:0.0:1783969528.602085:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 279: rc = 0 00100000:10000000:0.0:1783969528.603055:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 279: rc = 0 00100000:10000000:0.0:1783969528.603603:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 279: rc = 0 00100000:10000000:0.0:1783969528.604089:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 279: rc = 0 00100000:10000000:0.0:1783969528.604610:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 279: rc = 0 00100000:10000000:0.0:1783969528.605160:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 279: rc = 0 00100000:10000000:0.0:1783969528.605805:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 279: rc = 0 00100000:10000000:0.0:1783969528.606680:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 437: rc = 0 00100000:10000000:0.0:1783969528.607099:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 437: rc = 0 00100000:10000000:0.0:1783969528.607445:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 437: rc = 0 00100000:10000000:0.0:1783969528.607846:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 437: rc = 0 00100000:10000000:0.0:1783969528.608406:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 437: rc = 0 00100000:10000000:0.0:1783969528.608816:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 437: rc = 0 00100000:10000000:0.0:1783969528.609156:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 437: rc = 0 00100000:10000000:0.0:1783969528.609545:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 437: rc = 0 00100000:10000000:0.0:1783969528.610044:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 437: rc = 0 00100000:10000000:0.0:1783969528.610390:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 437: rc = 0 00100000:10000000:0.0:1783969528.611235:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 437: rc = 0 00100000:10000000:0.0:1783969528.611536:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 437: rc = 0 00100000:10000000:0.0:1783969528.612011:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 437: rc = 0 00100000:10000000:0.0:1783969528.612824:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 437: rc = 0 00100000:10000000:0.0:1783969528.613267:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 437: rc = 0 00100000:10000000:0.0:1783969528.613613:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 437: rc = 0 00100000:10000000:0.0:1783969528.614781:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 437: rc = 0 00100000:10000000:0.0:1783969528.615074:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 437: rc = 0 00100000:10000000:0.0:1783969528.615313:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 437: rc = 0 00100000:10000000:0.0:1783969528.615556:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 437: rc = 0 00100000:10000000:0.0:1783969528.618563:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 437: rc = 0 00100000:10000000:0.0:1783969528.618927:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 437: rc = 0 00100000:10000000:0.0:1783969528.619187:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 437: rc = 0 00100000:10000000:0.0:1783969528.619446:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 437: rc = 0 00100000:10000000:0.0:1783969528.619690:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 437: rc = 0 00100000:10000000:0.0:1783969528.619990:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 437: rc = 0 00100000:10000000:0.0:1783969528.620193:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 437: rc = 0 00100000:10000000:0.0:1783969528.620458:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 437: rc = 0 00100000:10000000:0.0:1783969528.620692:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 437: rc = 0 00100000:10000000:0.0:1783969528.620979:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 437: rc = 0 00100000:10000000:0.0:1783969528.621215:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 437: rc = 0 00100000:10000000:2.0:1783969528.622238:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 437: rc = 0 00100000:10000000:2.0:1783969528.622770:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 293: rc = 0 00100000:10000000:2.0:1783969528.623611:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1783969528.623840:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 772: rc = 0 00100000:10000000:2.0:1783969528.624134:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1783969528.624208:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 772: rc = 0 00100000:10000000:2.0:1783969528.624472:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1783969528.624539:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 772: rc = 0 00100000:10000000:2.0:1783969528.625101:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1783969528.625171:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 769: rc = 0 00100000:10000000:2.0:1783969528.625450:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1783969528.625519:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 769: rc = 0 00100000:10000000:2.0:1783969528.625759:0:14145:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1783969528.625828:0:14145:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 769: rc = 0 00000020:00000080:2.0:1783969528.626164:0:14145:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1783969528.626172:0:14145:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783969528.626181:0:14145:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbacf56d076fabd24 00000020:01000004:2.0:1783969528.626188:0:14145:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1783969528.626193:0:14145:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1783969528.626197:0:14145:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ac7c1809000 from MGS 00000020:01000004:2.0:1783969528.626200:0:14145:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1783969528.626210:0:14145:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9ac7ba6519c0) 00000020:00000080:2.0:1783969528.626225:0:14145:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1783969528.626271:0:14145:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac7c1809000 from MGS, refs=2 00080000:01000000:2.0:1783969528.626275:0:14145:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783969528.626280:0:14145:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbacf56d076fabd32 00000100:00100000:2.0:1783969528.626454:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1783969528.626573:0:14145:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1783969528.626579:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1783969528.627470:0:14145:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1783969528.627480:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1783969528.629466:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783969528.629625:0:14145:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1783969528.629631:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1783969528.630191:0:14145:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1783969528.630195:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1783969528.630473:0:14145:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1783969528.630479:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1783969528.631203:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969528.631207:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969528.631208:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969528.631459:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969528.631461:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969528.631462:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969528.632094:0:14145:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1783969528.637777:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1783969528.644274:0:14145:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1783969528.644291:0:14145:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783969528.644295:0:14145:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1783969528.649711:0:14154:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1783969528.649957:0:14145:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1783969528.650069:0:14145:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783969528.650594:0:14145:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783969528.651174:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783969528.651322:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783969528.651328:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1783969528.655380:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1783969528.655391:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1783969528.656023:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1783969528.656031:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1783969528.657050:0:14145:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1783969528.657069:0:14145:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.139@tcp' 00000020:01000004:2.0:1783969528.657071:0:14145:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1783969528.657099:0:14145:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.139@tcp (typ=mgc) 00000020:00000080:2.0:1783969528.657112:0:14145:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.139@tcp (ffff9ac7ba650000) 00000020:00000080:2.0:1783969528.657128:0:14145:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1783969528.657199:0:14145:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ac78616f000@MGC192.168.203.139@tcp: add connection 192.168.203.139@tcp at head 00010000:00010000:2.0:1783969528.657367:0:14145:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.139@tcp-0 is initialized 00000040:01000000:2.0:1783969528.657383:0:14145:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.139@tcp ctxt 1 is initialized 00000100:00080000:1.0:1783969528.657714:0:14159:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1783969528.659423:0:14160:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1783969528.659511:0:14145:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.139@tcp (uuid 5c75a22f-689e-4536-9c19-8125b0e8c51a) 00000020:00000080:1.0:1783969528.659537:0:14145:0:(genops.c:1406:class_connect()) connect: client 5c75a22f-689e-4536-9c19-8125b0e8c51a, cookie 0xbacf56d076fabd40 00000100:00080000:1.0:1783969528.659552:0:14145:0:(import.c:510:import_select_connection()) MGC192.168.203.139@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783969528.659567:0:14145:0:(import.c:624:import_select_connection()) MGC192.168.203.139@tcp: import ffff9ac78616f000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1783969528.659602:0:14145:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac7c1bbe680 x1870627280602752/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783969528.659644:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5c75a22f-689e-4536-9c19-8125b0e8c51a:3284:1870627280602752:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1783969528.659723:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783969528.659778:0:14145:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 5c75a22f-689e-4536-9c19-8125b0e8c51a->MGS 00000020:01000004:1.0:1783969528.659810:0:14145:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1783969528.659815:0:14145:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1783969528.659828:0:14145:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9ac7b6434d40) 00000020:00000080:1.0:1783969528.659840:0:14145:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1783969528.662990:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280602752 00000100:00100000:2.0:1783969528.663004:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280602752 00000100:00100000:2.0:1783969528.663047:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783969528.663055:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3284:x1870627280602752:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1783969528.663081:0:14155:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 5c75a22f-689e-4536-9c19-8125b0e8c51a@0@lo t0 exp 0000000000000000 cur 385 last 0 00000020:00000080:2.0:1783969528.663107:0:14155:0:(genops.c:1406:class_connect()) connect: client 5c75a22f-689e-4536-9c19-8125b0e8c51a, cookie 0xbacf56d076fabd4e 00000100:00080000:2.0:1783969528.663232:0:14155:0:(import.c:65:import_set_state_nolock()) ffff9ac78616a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783969528.663326:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+5:3284:x1870627280602752:12345-0@lo:250:mount.lustre.0 Request processed in 270us (3602us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969528.663341:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783969528.664957:0:3284:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.139@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1783969528.664974:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.139@tcp: connect to target with instance 0 00000100:00080000:1.0:1783969528.664983:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.139@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1783969528.664988:0:3284:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1783969528.664993:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9ac78616f000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1783969528.664995:0:3284:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1783969528.665008:0:3284:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1783969528.665014:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5c75a22f-689e-4536-9c19-8125b0e8c51a:3284:1870627280602752:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1783969528.676796:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783969528.680181:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1783969528.680191:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1783969528.682364:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1783969528.682386:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1783969528.683341:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1783969528.683352:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1783969528.684691:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783969528.684849:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1783969528.684854:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1783969528.686047:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1783969528.686056:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1783969528.735983:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783969528.736165:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1783969528.736171:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1783969528.738138:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1783969528.738150:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1783969528.739151:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783969528.739639:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783969528.739647:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1783969528.742429:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783969528.742459:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1783969528.743244:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783969528.744183:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783969528.744191:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1783969528.744967:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783969528.744975:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1783969528.746646:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783969528.746959:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783969528.746968:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1783969528.753520:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783969528.753542:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1783969528.789342:0:14145:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783969528.790161:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783969528.790168:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1783969528.791809:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783969528.791821:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1783969528.792729:0:14145:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783969528.792737:0:14145:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1783969528.794492:0:14145:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1783969528.794517:0:14145:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1783969528.794523:0:14145:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.139@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1783969528.794723:0:14145:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.139@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783969528.794819:0:14145:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.139@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1783969528.794824:0:14145:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783969528.794826:0:14145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783969528.794827:0:14145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783969528.794828:0:14145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783969528.794829:0:14145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783969528.794831:0:14145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783969528.794832:0:14145:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783969528.794834:0:14145:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783969528.794835:0:14145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783969528.794837:0:14145:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783969528.794839:0:14145:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1783969528.794841:0:14145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783969528.794843:0:14145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783969528.794844:0:14145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783969528.794844:0:14145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783969528.794845:0:14145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783969528.794846:0:14145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783969528.794847:0:14145:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783969528.794848:0:14145:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783969528.794849:0:14145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783969528.794850:0:14145:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783969528.794935:0:14145:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783969528.794955:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280602880:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783969528.795022:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969528.795109:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac790cb3780 going to sleep for 11 seconds 00000100:00100000:0.0:1783969528.795153:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280602880 00000100:00100000:0.0:1783969528.795159:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280602880 00000100:00100000:0.0:1783969528.795240:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783969528.795257:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+5:14145:x1870627280602880:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783969528.795431:0:14158:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783969528.795435:0:14158:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783969528.795438:0:14158:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1783969528.795796:0:14178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1783969528.796227:0:14158:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1783969528.797733:0:14179:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1783969528.797811:0:14179:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1783969528.797815:0:14179:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1783969528.797856:0:14179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1783969528.798708:0:14158:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783969528.798719:0:14158:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1783969528.810724:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+5:14145:x1870627280602880:12345-0@lo:253:mount.lustre.0 Request processed in 15459us (15692us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969528.810921:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783969528.811170:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280602880:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783969528.811184:0:14145:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783969528.811187:0:14145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783969528.811189:0:14145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783969528.811190:0:14145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783969528.811203:0:14145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783969528.811205:0:14145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783969528.811206:0:14145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783969528.811207:0:14145:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783969528.811209:0:14145:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783969528.811211:0:14145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783969528.811212:0:14145:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783969528.811230:0:14145:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ac7c1809000 from lustre-MDT0000 10000000:01000000:3.0:1783969528.811255:0:14145:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1783969528.811258:0:14145:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783969528.811262:0:14145:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ac7ba650000 10000000:01000000:3.0:1783969528.811267:0:14145:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783969528.811274:0:14145:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9ac7ba650000 from 1 10000000:01000000:3.0:1783969528.811278:0:14145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783969528.811463:0:14145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de7a00/0xbacf56d076fabd55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969528.811475:0:14145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac783de7a00/0xbacf56d076fabd55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969528.811486:0:14145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac783de7a00/0xbacf56d076fabd55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969528.811505:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785317480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280603008:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783969528.811546:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969528.811813:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac786283c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969528.811968:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280603008 00000100:00100000:1.0:1783969528.811975:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280603008 00000100:00100000:1.0:1783969528.812029:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783969528.812038:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+5:14145:x1870627280603008:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783969528.812050:0:14157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969528.812066:0:14157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7bf60f600/0xbacf56d076fabd5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076fabd55 expref: -99 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969528.812088:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7bf60f600/0xbacf56d076fabd5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076fabd55 expref: 6 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969528.812098:0:14157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7bf60f600/0xbacf56d076fabd5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fabd55 expref: 6 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969528.812108:0:14157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bf60f600, rc 0) 00000100:00100000:1.0:1783969528.812148:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+6:14145:x1870627280603008:12345-0@lo:101:mount.lustre.0 Request processed in 111us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969528.812154:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783969528.812278:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785317480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280603008:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783969528.812292:0:14145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac783de7a00/0xbacf56d076fabd55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabd5c expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969528.812301:0:14145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac783de7a00/0xbacf56d076fabd55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076fabd5c expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969528.812512:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785317480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280603136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969528.812541:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969528.812566:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac786283c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969528.812814:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280603136 00000100:00100000:1.0:1783969528.812819:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280603136 00000100:00100000:1.0:1783969528.812851:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783969528.812962:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+6:14145:x1870627280603136:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783969528.813240:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+6:14145:x1870627280603136:12345-0@lo:501:mount.lustre.0 Request processed in 381us (697us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783969528.813248:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783969528.814039:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785317480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280603136:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783969528.814074:0:14145:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783969528.814143:0:14145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de7a00/0xbacf56d076fabd55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabd5c expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969528.814154:0:14145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac783de7a00/0xbacf56d076fabd55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabd5c expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969528.814163:0:14145:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ac7c1809000 10000000:01000000:3.0:1783969528.814168:0:14145:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783969528.814173:0:14145:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ac7c1809000 10000000:01000000:3.0:1783969528.814175:0:14145:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783969528.814178:0:14145:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9ac7c1809000 from 1 10000000:01000000:3.0:1783969528.814181:0:14145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783969528.814208:0:14145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de7400/0xbacf56d076fabd63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969528.814215:0:14145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac783de7400/0xbacf56d076fabd63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969528.814224:0:14145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac783de7400/0xbacf56d076fabd63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969528.814242:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785317480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280603264:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783969528.814290:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969528.814332:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac786283c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783969528.814401:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280603264 00000100:00100000:2.0:1783969528.814408:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280603264 00000100:00100000:2.0:1783969528.814453:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783969528.814461:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+6:14145:x1870627280603264:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783969528.814471:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969528.814487:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac786099e00/0xbacf56d076fabd6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076fabd63 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969528.814508:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac786099e00/0xbacf56d076fabd6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076fabd63 expref: 7 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969528.814524:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac786099e00/0xbacf56d076fabd6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fabd63 expref: 7 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969528.814532:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786099e00, rc 0) 00000100:00100000:0.0:1783969528.814788:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785317480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280603264:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783969528.814803:0:14145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac783de7400/0xbacf56d076fabd63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabd6a expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969528.814812:0:14145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac783de7400/0xbacf56d076fabd63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076fabd6a expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969528.814824:0:14145:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00000100:00100000:2.0:1783969528.814855:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+7:14145:x1870627280603264:12345-0@lo:101:mount.lustre.0 Request processed in 394us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969528.814884:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1783969528.815288:0:14145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de7400/0xbacf56d076fabd63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabd6a expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969528.815351:0:14145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac783de7400/0xbacf56d076fabd63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabd6a expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969528.815427:0:14145:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783969528.815434:0:14145:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783969528.815440:0:14145:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ac7c1809000 10000000:01000000:0.0:1783969528.815443:0:14145:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783969528.815446:0:14145:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1783969528.815448:0:14145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783969528.815474:0:14145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb92200/0xbacf56d076fabd71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969528.815495:0:14145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb92200/0xbacf56d076fabd71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969528.815503:0:14145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb92200/0xbacf56d076fabd71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969528.815520:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280603392:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783969528.815559:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969528.815706:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac798c55540 going to sleep for 11 seconds 00000100:00100000:2.0:1783969528.815973:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280603392 00000100:00100000:2.0:1783969528.815980:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280603392 00000100:00100000:2.0:1783969528.816016:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783969528.816025:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac793b0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+7:14145:x1870627280603392:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783969528.816036:0:14158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969528.816048:0:14158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac786098200/0xbacf56d076fabd78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076fabd71 expref: -99 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969528.816068:0:14158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac786098200/0xbacf56d076fabd78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076fabd71 expref: 8 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969528.816078:0:14158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac786098200/0xbacf56d076fabd78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fabd71 expref: 8 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969528.816085:0:14158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786098200, rc 0) 00000100:00100000:2.0:1783969528.816166:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac793b0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+8:14145:x1870627280603392:12345-0@lo:101:mount.lustre.0 Request processed in 142us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969528.816173:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783969528.816273:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280603392:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783969528.816287:0:14145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb92200/0xbacf56d076fabd71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabd78 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969528.816295:0:14145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb92200/0xbacf56d076fabd71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076fabd78 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969528.816489:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280603520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969528.816520:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969528.816590:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac786283900 going to sleep for 11 seconds 00000100:00100000:2.0:1783969528.816800:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280603520 00000100:00100000:2.0:1783969528.816805:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280603520 00000100:00100000:2.0:1783969528.816999:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783969528.817008:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac793b0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+8:14145:x1870627280603520:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783969528.817431:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac793b0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+9:14145:x1870627280603520:12345-0@lo:501:mount.lustre.0 Request processed in 424us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969528.817439:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783969528.817511:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280603520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969528.817546:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280603648:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783969528.817604:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969528.818613:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac786283900 going to sleep for 11 seconds 00000100:00100000:1.0:1783969528.819489:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280603648 00000100:00100000:1.0:1783969528.819498:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280603648 00000100:00100000:1.0:1783969528.819545:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783969528.819553:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac793b0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+9:14145:x1870627280603648:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783969528.820179:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac793b0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+9:14145:x1870627280603648:12345-0@lo:503:mount.lustre.0 Request processed in 625us (2573us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969528.820194:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783969528.820295:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280603648:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783969528.820987:0:14180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c75a22f-689e-4536-9c19-8125b0e8c51a:14180:1870627280603776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969528.821036:0:14180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969528.821073:0:14180:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac786283c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969528.821115:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280603776 00000100:00100000:1.0:1783969528.821120:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280603776 00000100:00100000:1.0:1783969528.821146:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783969528.821153:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c151dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+9:14180:x1870627280603776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969528.821425:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c151dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+9:14180:x1870627280603776:12345-0@lo:502:llog_process_th.0 Request processed in 272us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969528.821433:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783969528.821587:0:14180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c75a22f-689e-4536-9c19-8125b0e8c51a:14180:1870627280603776:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783969528.821613:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969528.821623:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969528.821625:0:14180:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783969528.821631:0:14180:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1783969528.821640:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783969528.821655:0:14180:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9ac7ba730000) 00000020:00000080:3.0:1783969528.821671:0:14180:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1783969528.821690:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1783969528.821761:0:14180:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1783969528.821768:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbacf56d076fabd86 00000020:00000080:3.0:1783969528.821997:0:14180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783969528.822001:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969528.822005:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969528.822006:0:14180:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783969528.822009:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969528.822012:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969528.822013:0:14180:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1783969528.822017:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783969528.822023:0:14180:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9ac7ba733380) 00000020:00000080:3.0:1783969528.822032:0:14180:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1783969528.822036:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1783969528.822037:0:14180:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1783969528.822040:0:14180:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1783969528.822046:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783969528.822093:0:14180:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac7c1809000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1783969528.822106:0:14180:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9ac7ba734d40) 00000020:00000080:3.0:1783969528.822114:0:14180:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1783969528.822153:0:14180:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1783969528.822158:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbacf56d076fabd9b 00000020:00000080:3.0:1783969528.822245:0:14180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1783969528.822252:0:14180:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1783969528.822256:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xbacf56d076fabda2 00080000:01000000:3.0:1783969528.822261:0:14180:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1783969528.822264:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbacf56d076fabda9 00010000:00010000:3.0:1783969528.939837:0:14180:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1783969528.940501:0:14180:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:3.0:1783969528.940678:0:14180:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1783969528.942012:0:14180:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9ac7ba7319c0) 00000020:00000080:3.0:1783969528.942031:0:14180:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1783969528.942093:0:14180:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1783969528.942100:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbacf56d076fabdb7 00000020:00000080:0.0:1783969528.945156:0:14180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1783969528.961103:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xbacf56d076fabdbe 00000020:00000080:0.0:1783969528.966534:0:14180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1783969528.966548:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969528.966557:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969528.966559:0:14180:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1783969528.966564:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783969528.966567:0:14180:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1783969528.966569:0:14180:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783969528.966570:0:14180:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783969528.966571:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783969528.966574:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969528.966575:0:14180:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783969528.966578:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969528.966582:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969528.966584:0:14180:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1783969528.966588:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1783969528.966633:0:14180:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1783969528.966646:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969528.966649:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969528.966650:0:14180:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1783969528.966662:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783969528.966665:0:14180:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1783969528.966669:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969528.966671:0:14180:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1783969528.966684:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783969528.966690:0:14180:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.139@tcp to nid 0x20000c0a8cb8b (192.168.203.139@tcp) 00000020:01000000:0.0:1783969528.966718:0:14180:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783969528.966720:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783969528.966746:0:14180:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ac7917f0000) 00000020:00000080:0.0:1783969528.966763:0:14180:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1783969528.966769:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783969528.966820:0:14180:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1783969528.966834:0:14180:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1783969528.966841:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbacf56d076fabdcc 00010000:00080000:0.0:1783969528.966925:0:14180:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ac791bb0000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.139@tcp at head 00010000:00010000:0.0:1783969528.967126:0:14180:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1783969528.967524:0:14180:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783969528.967578:0:14180:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1783969528.968542:0:14180:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783969528.968613:0:14180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1783969528.968683:0:14180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1783969528.969999:0:14184:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783969528.970005:0:14184:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1783969528.970755:0:14180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783969528.970766:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783969528.970798:0:14180:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1783969528.970817:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbacf56d076fabdd3 00000100:00080000:0.0:1783969528.970827:0:14180:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783969528.970833:0:14180:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ac791bb0000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783969528.970959:0:14180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac7bf6b2680 x1870627280603904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783969528.970980:0:14180:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1783969528.971007:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1870627280603904:0@lo:8:llog_process_th.0 00000020:01000000:0.0:1783969528.971037:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969528.971041:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969528.971043:0:14180:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1783969528.971045:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783969528.971047:0:14180:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1783969528.971049:0:14180:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783969528.971050:0:14180:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783969528.971052:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783969528.971054:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969528.971055:0:14180:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783969528.971057:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783969528.971061:0:14180:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1783969528.971064:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969528.971065:0:14180:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000400:00000100:1.0:1783969528.971068:0:3284:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870627280603904 offset 0 length 520: 4 00000020:00000080:0.0:1783969528.971068:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783969528.971071:0:14180:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.139@tcp to nid 0x20000c0a8cb8b (192.168.203.139@tcp) 00000020:01000000:0.0:1783969528.971090:0:14180:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783969528.971092:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783969528.971103:0:14180:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ac7917f4d40) 00000020:00000080:0.0:1783969528.971114:0:14180:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1783969528.971118:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783969528.971168:0:14180:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1783969528.971173:0:14180:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000100:00100000:1.0:1783969528.971250:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1beb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c75a22f-689e-4536-9c19-8125b0e8c51a:3288:1870627280604032:0@lo:400:kworker.0 00000100:00100000:1.0:1783969528.971284:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969528.971351:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280604032 00000100:00100000:2.0:1783969528.971357:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280604032 00000100:00100000:2.0:1783969528.971417:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783969528.971426:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c151c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+9:3288:x1870627280604032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969528.971476:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c151c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+9:3288:x1870627280604032:12345-0@lo:400:kworker.0 Request processed in 51us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969528.971483:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783969528.971569:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1beb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c75a22f-689e-4536-9c19-8125b0e8c51a:3288:1870627280604032:0@lo:400:kworker.0 00000020:00000080:0.0:1783969528.972391:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbacf56d076fabde1 00010000:00080000:0.0:1783969528.972451:0:14180:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ac7c04f7000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.139@tcp at head 00010000:00010000:0.0:1783969528.972664:0:14180:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1783969528.972845:0:14180:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1783969528.973166:0:14180:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1783969528.973716:0:14180:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783969528.973793:0:14180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1783969528.974172:0:14180:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1783969528.975560:0:14186:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783969528.975566:0:14186:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1783969528.976802:0:14180:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783969528.976815:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1783969528.977006:0:14180:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1783969528.977026:0:14180:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbacf56d076fabde8 00000100:00080000:0.0:1783969528.977037:0:14180:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783969528.977043:0:14180:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ac7c04f7000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783969528.977077:0:14180:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac7bf6b3800 x1870627280604160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783969528.977104:0:14180:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1783969528.977289:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1870627280604160:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1783969528.977385:0:3284:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870627280604160 offset 0 length 520: 4 00000020:01000000:0.0:1783969528.977483:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969528.977487:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969528.977489:0:14180:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1783969528.977492:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969528.977496:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969528.977497:0:14180:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783969528.977501:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783969528.977503:0:14180:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783969528.977505:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969528.977508:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969528.977509:0:14180:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783969528.977511:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969528.977513:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969528.977514:0:14180:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783969528.977518:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783969528.977545:0:14180:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c75a22f-689e-4536-9c19-8125b0e8c51a:14180:1870627280604288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969528.977592:0:14180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969528.977619:0:14180:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfda6840 going to sleep for 11 seconds 00000100:00100000:1.0:1783969528.977677:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280604288 00000100:00100000:1.0:1783969528.977685:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280604288 00000100:00100000:1.0:1783969528.977726:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783969528.977734:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c151c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+9:14180:x1870627280604288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969528.977982:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c151c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+9:14180:x1870627280604288:12345-0@lo:502:llog_process_th.0 Request processed in 248us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969528.977990:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783969528.978145:0:14180:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c75a22f-689e-4536-9c19-8125b0e8c51a:14180:1870627280604288:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783969528.978170:0:14180:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969528.978175:0:14180:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969528.978176:0:14180:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783969528.978191:0:14180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1783969528.978365:0:14145:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1783969528.978393:0:14145:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783969528.978420:0:14145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb92200/0xbacf56d076fabd71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabd78 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969528.978431:0:14145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb92200/0xbacf56d076fabd71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabd78 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969528.978439:0:14145:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ac7c1809000 from 1 10000000:01000000:1.0:1783969528.978442:0:14145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783969528.978468:0:14145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f400/0xbacf56d076fabdef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969528.978476:0:14145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f400/0xbacf56d076fabdef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969528.978484:0:14145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f400/0xbacf56d076fabdef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969528.978498:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280604416:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783969528.978526:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969528.978551:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280604416 00000100:00100000:1.0:1783969528.978555:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280604416 00000100:00100000:1.0:1783969528.978576:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783969528.978582:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c151d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+9:14145:x1870627280604416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783969528.978591:0:14157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969528.978604:0:14157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7bf60fe00/0xbacf56d076fabdf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076fabdef expref: -99 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969528.978622:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7bf60fe00/0xbacf56d076fabdf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076fabdef expref: 10 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969528.978642:0:14157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7bf60fe00/0xbacf56d076fabdf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fabdef expref: 10 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969528.978650:0:14157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bf60fe00, rc 0) 00000100:00100000:1.0:1783969528.978674:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c151d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+10:14145:x1870627280604416:12345-0@lo:101:mount.lustre.0 Request processed in 93us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969528.978681:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783969528.978711:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7a0294d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783969528.978723:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280604416:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783969528.978735:0:14145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f400/0xbacf56d076fabdef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabdf6 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969528.978743:0:14145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f400/0xbacf56d076fabdef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076fabdf6 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969528.979450:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280604544:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1783969528.979489:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969528.979521:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280604544 00000100:00100000:1.0:1783969528.979526:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280604544 00000100:00100000:1.0:1783969528.979551:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783969528.979558:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c151e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+10:14145:x1870627280604544:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1783969528.979572:0:14158:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1783969528.979576:0:14158:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1783969528.979634:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c151e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+10:14145:x1870627280604544:12345-0@lo:256:mount.lustre.0 Request processed in 75us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969528.979640:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783969528.979725:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7a0294d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783969528.979740:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280604544:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1783969528.980590:0:14145:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783969528.980615:0:14145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f400/0xbacf56d076fabdef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabdf6 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969528.980626:0:14145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f400/0xbacf56d076fabdef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabdf6 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969528.980634:0:14145:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ac7c1809000 from 1 10000000:01000000:1.0:1783969528.980637:0:14145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783969528.980660:0:14145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60ee00/0xbacf56d076fabdfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969528.980667:0:14145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60ee00/0xbacf56d076fabdfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969528.980675:0:14145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60ee00/0xbacf56d076fabdfd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969528.980692:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280604672:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783969528.980724:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969528.980825:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac790f960c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969528.986357:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280604672 00000100:00100000:2.0:1783969528.986446:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280604672 00000100:00100000:2.0:1783969528.986510:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783969528.986521:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c151c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+10:14145:x1870627280604672:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783969528.986537:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969528.986558:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac786098000/0xbacf56d076fabe04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076fabdfd expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969528.986648:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac786098000/0xbacf56d076fabe04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076fabdfd expref: 11 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969528.986660:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac786098000/0xbacf56d076fabe04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fabdfd expref: 11 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969528.986806:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786098000, rc 0) 00000100:00100000:2.0:1783969528.987528:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c151c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+11:14145:x1870627280604672:12345-0@lo:101:mount.lustre.0 Request processed in 1008us (6801us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969528.987537:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783969528.987599:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280604672:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783969528.987627:0:14145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60ee00/0xbacf56d076fabdfd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabe04 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969528.987637:0:14145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60ee00/0xbacf56d076fabdfd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076fabe04 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969528.987717:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280604800:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783969528.987753:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969528.987823:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac790f960c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969528.988122:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280604800 00000100:00100000:0.0:1783969528.988133:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280604800 00000100:00100000:0.0:1783969528.988189:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783969528.988198:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c151fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+11:14145:x1870627280604800:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783969528.988543:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c151fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+11:14145:x1870627280604800:12345-0@lo:501:mount.lustre.0 Request processed in 346us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969528.988550:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783969528.988607:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280604800:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969528.988638:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280604928:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783969528.988671:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969528.988810:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b00ca540 going to sleep for 11 seconds 00000100:00100000:1.0:1783969528.989050:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280604928 00000100:00100000:1.0:1783969528.989054:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280604928 00000100:00100000:1.0:1783969528.989077:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783969528.989083:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c151e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+11:14145:x1870627280604928:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783969528.989245:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c151e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+11:14145:x1870627280604928:12345-0@lo:503:mount.lustre.0 Request processed in 162us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969528.989252:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783969528.989339:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280604928:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783969528.989766:0:14188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c75a22f-689e-4536-9c19-8125b0e8c51a:14188:1870627280605056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969528.989802:0:14188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969528.989827:0:14188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfda63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969528.990110:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280605056 00000100:00100000:1.0:1783969528.990115:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280605056 00000100:00100000:1.0:1783969528.990148:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783969528.990155:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c151e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+11:14188:x1870627280605056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969528.990495:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c151e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+11:14188:x1870627280605056:12345-0@lo:502:llog_process_th.0 Request processed in 339us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969528.990502:0:14188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c75a22f-689e-4536-9c19-8125b0e8c51a:14188:1870627280605056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969528.990502:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000020:01000000:3.0:1783969528.990528:0:14188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969528.990537:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969528.990539:0:14188:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783969528.990547:0:14188:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac7c1809000 00000020:00000080:3.0:1783969528.990550:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783969528.990557:0:14188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969528.990559:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969528.990561:0:14188:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783969528.990563:0:14188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969528.990566:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969528.990567:0:14188:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783969528.990570:0:14188:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac7c1809000 00000020:00000080:3.0:1783969528.990572:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783969528.990626:0:14188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969528.990630:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969528.990631:0:14188:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783969528.990634:0:14188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783969528.990643:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969528.990644:0:14188:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783969528.990649:0:14188:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ac7c1809000 00000020:00000080:3.0:1783969528.990651:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783969528.990814:0:14188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c75a22f-689e-4536-9c19-8125b0e8c51a:14188:1870627280605184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969528.991079:0:14188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969528.991113:0:14188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac788557e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783969528.991201:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280605184 00000100:00100000:0.0:1783969528.991206:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280605184 00000100:00100000:0.0:1783969528.991280:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783969528.991287:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c151d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+11:14188:x1870627280605184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969528.991457:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c151d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+11:14188:x1870627280605184:12345-0@lo:502:llog_process_th.0 Request processed in 169us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969528.991464:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783969528.991533:0:14188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c75a22f-689e-4536-9c19-8125b0e8c51a:14188:1870627280605184:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783969528.991555:0:14188:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783969528.991560:0:14188:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969528.991562:0:14188:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783969528.991566:0:14188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1783969528.991672:0:14145:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1783969528.991704:0:14145:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783969528.991718:0:14145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60ee00/0xbacf56d076fabdfd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabe04 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969528.991730:0:14145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60ee00/0xbacf56d076fabdfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabe04 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969528.991780:0:14145:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783969528.991783:0:14145:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ac7c1809000 10000000:01000000:3.0:1783969528.991785:0:14145:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ac7c1809000 10000000:01000000:3.0:1783969528.991789:0:14145:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783969528.991794:0:14145:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ac7c1809000 from 1 10000000:01000000:3.0:1783969528.991798:0:14145:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783969528.991822:0:14145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de7200/0xbacf56d076fabe0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969528.991852:0:14145:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac783de7200/0xbacf56d076fabe0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969528.991899:0:14145:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac783de7200/0xbacf56d076fabe0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969528.991930:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280605312:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783969528.991971:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969528.997293:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac788557f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783969528.997410:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280605312 00000100:00100000:2.0:1783969528.997429:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280605312 00000100:00100000:2.0:1783969528.997533:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783969528.997548:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c151cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+11:14145:x1870627280605312:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783969528.997580:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969528.997615:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac786099800/0xbacf56d076fabe12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076fabe0b expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969528.997657:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac786099800/0xbacf56d076fabe12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076fabe0b expref: 12 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969528.997681:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac786099800/0xbacf56d076fabe12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fabe0b expref: 12 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969528.997697:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786099800, rc 0) 00000100:00100000:2.0:1783969528.997810:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c151cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+12:14145:x1870627280605312:12345-0@lo:101:mount.lustre.0 Request processed in 267us (5838us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969528.997819:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783969528.997888:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280605312:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783969528.997915:0:14145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac783de7200/0xbacf56d076fabe0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabe12 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969528.997928:0:14145:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac783de7200/0xbacf56d076fabe0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076fabe12 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969528.998013:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280605440:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969528.998064:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969528.998093:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280605440 00000100:00100000:3.0:1783969528.998098:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280605440 00000100:00100000:3.0:1783969528.998127:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783969528.998135:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c151f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+13:14145:x1870627280605440:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969528.998379:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c151f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+13:14145:x1870627280605440:12345-0@lo:501:mount.lustre.0 Request processed in 234us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969528.998387:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783969528.998424:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac788557f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783969528.998437:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280605440:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969528.998463:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280605568:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783969528.998503:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969528.998526:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac788557f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969528.998646:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280605568 00000100:00100000:1.0:1783969528.998651:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280605568 00000100:00100000:1.0:1783969528.998674:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783969528.998681:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac791508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+13:14145:x1870627280605568:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783969528.998844:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac791508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+13:14145:x1870627280605568:12345-0@lo:503:mount.lustre.0 Request processed in 163us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969528.998851:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783969529.001135:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280605568:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783969529.002551:0:14192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c75a22f-689e-4536-9c19-8125b0e8c51a:14192:1870627280605696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783969529.002628:0:14192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969529.002672:0:14192:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7c1579180 going to sleep for 11 seconds 00000100:00100000:0.0:1783969529.003203:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280605696 00000100:00100000:0.0:1783969529.003220:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280605696 00000100:00100000:0.0:1783969529.003300:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783969529.003314:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac791508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+12:14192:x1870627280605696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783969529.003710:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac791508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+12:14192:x1870627280605696:12345-0@lo:502:llog_process_th.0 Request processed in 398us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969529.003720:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783969529.003748:0:14192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c75a22f-689e-4536-9c19-8125b0e8c51a:14192:1870627280605696:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1783969529.003827:0:14192:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1783969529.003855:0:14192:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9ac7c1fbcd40) 00000020:00000080:3.0:1783969529.003916:0:14192:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1783969529.010048:0:14192:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac7c1809000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783969529.010055:0:14192:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ac7c1809000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783969529.010059:0:14192:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac7c1809000 4 00010000:00080000:3.0:1783969529.010103:0:14192:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ac682862000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.139@tcp at head 00010000:00010000:3.0:1783969529.011940:0:14192:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1783969529.012054:0:14192:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1783969529.012090:0:14192:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783969529.012104:0:14192:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xbacf56d076fabe20 00000100:00080000:3.0:1783969529.012114:0:14192:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783969529.012122:0:14192:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ac682862000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1783969529.012159:0:14192:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac785314e00 x1870627280605824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783969529.012185:0:14192:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783969529.012636:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1870627280605824:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783969529.012716:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969529.012817:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280605824 00000100:00100000:1.0:1783969529.012824:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280605824 00000100:00100000:1.0:1783969529.012944:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783969529.012954:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3284:x1870627280605824:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783969529.013014:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3284:x1870627280605824:12345-0@lo:38:llog_process_th.0 Request processed in 60us (297us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783969529.013022:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783969529.013062:0:3284:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783969529.013071:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9ac682862000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783969529.013075:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783969529.013080:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1870627280605824:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783969529.014960:0:14192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c75a22f-689e-4536-9c19-8125b0e8c51a:14192:1870627280605952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969529.015030:0:14192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969529.015068:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280605952 00000100:00100000:1.0:1783969529.015074:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280605952 00000100:00100000:1.0:1783969529.015449:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783969529.015459:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79150bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+12:14192:x1870627280605952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783969529.015768:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79150bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+12:14192:x1870627280605952:12345-0@lo:502:llog_process_th.0 Request processed in 310us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969529.015775:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783969529.015824:0:14192:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac798f95b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783969529.015844:0:14192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5c75a22f-689e-4536-9c19-8125b0e8c51a:14192:1870627280605952:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783969529.015960:0:14192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1783969529.016296:0:14145:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1783969529.016316:0:14145:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783969529.016338:0:14145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de7200/0xbacf56d076fabe0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabe12 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969529.016361:0:14145:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac783de7200/0xbacf56d076fabe0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabe12 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783969529.016429:0:14145:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783969529.016431:0:14145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783969529.016433:0:14145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969529.016434:0:14145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969529.016435:0:14145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969529.016436:0:14145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969529.016438:0:14145:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783969529.016439:0:14145:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783969529.016441:0:14145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969529.016442:0:14145:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783969529.016445:0:14145:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1783969529.016448:0:14145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783969529.016449:0:14145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783969529.016450:0:14145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969529.016451:0:14145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969529.016452:0:14145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969529.016453:0:14145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969529.016454:0:14145:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783969529.016455:0:14145:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783969529.016456:0:14145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969529.016458:0:14145:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783969529.016477:0:14145:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783969529.016493:0:14145:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280606080:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783969529.016548:0:14145:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969529.016572:0:14145:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac790e91240 going to sleep for 11 seconds 00000100:00100000:0.0:1783969529.016815:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280606080 00000100:00100000:0.0:1783969529.017033:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280606080 00000100:00100000:1.0:1783969529.017401:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783969529.017418:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac791509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+12:14145:x1870627280606080:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783969529.017453:0:14157:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783969529.017466:0:14157:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783969529.071671:0:14157:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783969529.071689:0:14157:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1783969529.071821:0:14178:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783969529.071826:0:14178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783969529.071848:0:14178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac786098400/0xbacf56d076fabe27 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969529.071886:0:14178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac7bf60fe00/0xbacf56d076fabdf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fabdef expref: 12 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969529.071908:0:14178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ac786098400/0xbacf56d076fabe27 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969529.071945:0:14178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac7bf60fe00/0xbacf56d076fabdf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076fabdef expref: 12 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969529.071959:0:14178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac7bf60fe00/0xbacf56d076fabdf6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076fabdef expref: 12 pid: 14157 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969529.071973:0:14178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1be9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14178:1870627280606208:0@lo:104: 00000100:00100000:2.0:1783969529.072033:0:14178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969529.072114:0:14178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac790e91600 going to sleep for 11 seconds 00000100:00100000:3.0:1783969529.072174:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280606208 00000100:00100000:3.0:1783969529.072180:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280606208 00000100:00100000:3.0:1783969529.072254:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783969529.072263:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c75a22f-689e-4536-9c19-8125b0e8c51a+3:14178:x1870627280606208:12345-0@lo:104: 00010000:00010000:3.0:1783969529.072384:0:14146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f400/0xbacf56d076fabdef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076fabdf6 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.072441:0:14146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783969529.072448:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c75a22f-689e-4536-9c19-8125b0e8c51a+3:14178:x1870627280606208:12345-0@lo:104: Request processed in 186us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969529.072455:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1783969529.072510:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969529.072517:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f400/0xbacf56d076fabdef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076fabdf6 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969529.072531:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60f400 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:0.0:1783969529.072534:0:14152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f400/0xbacf56d076fabdef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076fabdf6 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969529.072542:0:14178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1be9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14178:1870627280606208:0@lo:104: 00010000:00010000:0.0:1783969529.072542:0:14152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f400/0xbacf56d076fabdef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076fabdf6 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783969529.072549:0:14152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f400/0xbacf56d076fabdef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076fabdf6 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969529.072554:0:14152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783969529.072560:0:14178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ac786098400/0xbacf56d076fabe27 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969529.072580:0:14152:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f400/0xbacf56d076fabdef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076fabdf6 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969529.072587:0:14152:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783969529.072609:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f400/0xbacf56d076fabdef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076fabdf6 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969529.072617:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f400/0xbacf56d076fabdef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076fabdf6 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969529.072632:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969529.072634:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969529.072635:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969529.072647:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c75a22f-689e-4536-9c19-8125b0e8c51a:3285:1870627280606336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783969529.072738:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969529.072839:0:14148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280606336 00000100:00100000:3.0:1783969529.072844:0:14148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280606336 00010000:00010000:3.0:1783969529.072878:0:14148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac7bf60fe00/0xbacf56d076fabdf6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076fabdef expref: 13 pid: 14157 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969529.072938:0:14148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783969529.072945:0:14148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c75a22f-689e-4536-9c19-8125b0e8c51a+13:3285:x1870627280606336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969529.072955:0:14148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969529.072960:0:14148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac7bf60fe00/0xbacf56d076fabdf6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076fabdef expref: 13 pid: 14157 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.072970:0:14148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac7bf60fe00/0xbacf56d076fabdf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076fabdef expref: 13 pid: 14157 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.072984:0:14148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7bf60fe00/0xbacf56d076fabdf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076fabdef expref: 13 pid: 14157 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.072997:0:14148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ac786098400/0xbacf56d076fabe27 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.073006:0:14148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac786098400/0xbacf56d076fabe27 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783969529.073026:0:14148:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001201053s 00010000:00010000:3.0:1783969529.073031:0:14148:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac786098400/0xbacf56d076fabe27 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.073038:0:14148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac786098400/0xbacf56d076fabe27 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.073045:0:14148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac786098400/0xbacf56d076fabe27 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.073052:0:14148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac786098400/0xbacf56d076fabe27 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.073058:0:14148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786098400 already unused, calling callback (ffffffffc1485230) 00010000:00010000:3.0:1783969529.073062:0:14148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac786098400/0xbacf56d076fabe27 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.073069:0:14148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac786098400/0xbacf56d076fabe27 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969529.073195:0:14178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ac786098400/0xbacf56d076fabe27 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969529.073203:0:14178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac786098400/0xbacf56d076fabe27 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.073240:0:14148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac786098400/0xbacf56d076fabe27 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.073249:0:14148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac786098400/0xbacf56d076fabe27 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969529.073262:0:14148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969529.073352:0:14148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5c75a22f-689e-4536-9c19-8125b0e8c51a+12:3285:x1870627280606336:12345-0@lo:103:ldlm_bl.0 Request processed in 408us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969529.073360:0:14148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783969529.073421:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c75a22f-689e-4536-9c19-8125b0e8c51a:3285:1870627280606336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969529.077750:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac791509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+11:14145:x1870627280606080:12345-0@lo:253:mount.lustre.0 Request processed in 60324us (61192us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969529.077764:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783969529.077923:0:14145:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14145:1870627280606080:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783969529.077937:0:14145:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783969529.077941:0:14145:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783969529.077943:0:14145:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783969529.077944:0:14145:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969529.077945:0:14145:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969529.077946:0:14145:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969529.077947:0:14145:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969529.077948:0:14145:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783969529.077960:0:14145:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783969529.077962:0:14145:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969529.077963:0:14145:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783969529.077981:0:14145:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783969529.084098:0:14145:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1783969529.084256:0:14145:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783969529.084543:0:14145:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1783969529.084687:0:14145:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783969529.084974:0:14145:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1783969529.085147:0:14145:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1783969529.086079:0:14145:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1783969529.086245:0:14145:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1783969529.086537:0:14145:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1783969529.086764:0:14145:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1783969529.087061:0:14145:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1783969529.087227:0:14145:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1783969529.114650:0:14145:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1783969529.115251:0:14145:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1783969529.115418:0:14200:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1783969529.115422:0:14200:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1783969529.115513:0:14201:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1783969529.115585:0:14201:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783969529.118966:0:14201:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783969529.119035:0:14201:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783969529.119039:0:14201:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1783969529.120718:0:14145:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1783969529.120844:0:14145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1783969529.121302:0:14145:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1783969529.121311:0:14145:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1783969529.124595:0:14145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783969529.126209:0:14145:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1783969529.127452:0:14145:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1783969529.127499:0:14145:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1783969529.129349:0:14145:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1783969529.135205:0:14145:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1783969529.163587:0:14145:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1783969529.163618:0:14145:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffc0f301d27988 00100000:10000000:2.0:1783969529.163626:0:14145:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1783969529.164527:0:14145:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783969529.164542:0:14145:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.139@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783969529.164555:0:14145:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1783969529.164580:0:14145:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1783969529.639659:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783969530.085455:0:14197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1783969530.085659:0:14160:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783969530.085664:0:14160:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ac7c1809000 from 6 10000000:01000000:0.0:1783969530.085677:0:14160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783969530.085733:0:14160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93c00/0xbacf56d076fabe2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969530.085744:0:14160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93c00/0xbacf56d076fabe2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969530.085755:0:14160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93c00/0xbacf56d076fabe2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969530.085779:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280606464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783969530.085841:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969530.085971:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7887233c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969530.092348:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280606464 00000100:00100000:1.0:1783969530.092372:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280606464 00000100:00100000:1.0:1783969530.092431:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783969530.092441:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79150a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+11:14160:x1870627280606464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783969530.092457:0:14158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969530.092477:0:14158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7bf60e200/0xbacf56d076fabe35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076fabe2e expref: -99 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969530.092504:0:14158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7bf60e200/0xbacf56d076fabe35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076fabe2e expref: 12 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969530.092516:0:14158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7bf60e200/0xbacf56d076fabe35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fabe2e expref: 12 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969530.092542:0:14158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bf60e200, rc 0) 00000100:00100000:1.0:1783969530.092625:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79150a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+12:14160:x1870627280606464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (6783us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969530.092632:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783969530.093131:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280606464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969530.093150:0:14160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93c00/0xbacf56d076fabe2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabe35 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969530.093169:0:14160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93c00/0xbacf56d076fabe2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076fabe35 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969530.093235:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785317b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280606592:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783969530.093275:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969530.093313:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7c15799c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969530.093443:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280606592 00000100:00100000:1.0:1783969530.093449:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280606592 00000100:00100000:1.0:1783969530.093486:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783969530.093492:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7883c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+12:14160:x1870627280606592:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783969530.093507:0:14157:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783969530.093521:0:14157:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783969530.093524:0:14157:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1783969530.093602:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7883c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+12:14160:x1870627280606592:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969530.093609:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783969530.093641:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785317b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280606592:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783969530.093699:0:14160:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783969530.093722:0:14160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93c00/0xbacf56d076fabe2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabe35 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969530.093730:0:14160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93c00/0xbacf56d076fabe2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabe35 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969530.672513:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783969531.109558:0:14197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783969531.688973:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969532.708990:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783969533.570844:0:14444:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783969533.733158:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783969534.056602:0:483:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969534.056610:0:483:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783969534.056625:0:483:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969534.056628:0:483:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783969534.056631:0:483:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783969534.056634:0:483:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783969534.056638:0:483:0:(import.c:65:import_set_state_nolock()) ffff9ac682862000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783969534.056660:0:483:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ac682862000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1783969534.056684:0:483:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac7c1bbd500 x1870627280606848/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783969534.056711:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969534.056721:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c75a22f-689e-4536-9c19-8125b0e8c51a:3285:1870627280606720:0@lo:400:kworker.0 00000100:00100000:1.0:1783969534.056787:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969534.056842:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280606720 00000100:00100000:1.0:1783969534.056849:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280606720 00000100:00100000:1.0:1783969534.056937:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783969534.056946:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7883c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+12:3285:x1870627280606720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969534.056999:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7883c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+12:3285:x1870627280606720:12345-0@lo:400:kworker.0 Request processed in 54us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969534.057007:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783969534.057064:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c75a22f-689e-4536-9c19-8125b0e8c51a:3285:1870627280606720:0@lo:400:kworker.0 00000100:00100000:0.0:1783969534.057213:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1870627280606848:0@lo:38:kworker.0 00000100:00100000:0.0:1783969534.057252:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969534.057405:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280606848 00000100:00100000:1.0:1783969534.057410:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280606848 00000100:00100000:1.0:1783969534.057437:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783969534.057443:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3284:x1870627280606848:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1783969534.057466:0:14164:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 391 last 0 00000020:00000080:1.0:1783969534.057504:0:14164:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xbacf56d076fabe3c 00000004:00100000:1.0:1783969534.057527:0:14164:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783969534.057686:0:14164:0:(import.c:65:import_set_state_nolock()) ffff9ac7ba65c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783969534.057729:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3284:x1870627280606848:12345-0@lo:38:kworker.0 Request processed in 284us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969534.057735:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783969534.057855:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ac7c1bbd500 x1870627280606848/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783969544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783969534.058044:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1783969534.058053:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1783969534.058058:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783969534.058061:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9ac682862000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783969534.058067:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3284:1870627280606848:0@lo:38:kworker.0 00010000:00010000:0.0:1783969534.758408:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969535.783349:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783969536.566560:0:14594:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd9ad5f530 20000000:00000080:0.0:1783969536.566578:0:14594:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ac7c1f5b400 uarg=0000000000000000 20000000:01000000:0.0:1783969536.566610:0:14594:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1783969536.566618:0:14594:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1783969536.566623:0:14594:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1783969536.568212:0:14595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1783969536.568360:0:14594:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1783969536.582246:0:14594:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783969536.582277:0:14594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac783de6200/0xbacf56d076fabe43 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.582295:0:14594:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac786098000/0xbacf56d076fabe04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fabdfd expref: 11 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.582722:0:14594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ac783de6200/0xbacf56d076fabe43 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.582769:0:14594:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac786098000/0xbacf56d076fabe04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076fabdfd expref: 11 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969536.582783:0:14594:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac786098000/0xbacf56d076fabe04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076fabdfd expref: 11 pid: 14155 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969536.582799:0:14594:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785316a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14594:1870627280606976:0@lo:104: 00000100:00100000:3.0:1783969536.582898:0:14594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969536.583077:0:14594:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac791f79e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783969536.583383:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280606976 00000100:00100000:2.0:1783969536.583391:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280606976 00000100:00100000:2.0:1783969536.583436:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783969536.583444:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785315500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c75a22f-689e-4536-9c19-8125b0e8c51a+3:14594:x1870627280606976:12345-0@lo:104: 00010000:00010000:2.0:1783969536.583458:0:14146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60ee00/0xbacf56d076fabdfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076fabe04 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.583525:0:14146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783969536.583532:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785315500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c75a22f-689e-4536-9c19-8125b0e8c51a+3:14594:x1870627280606976:12345-0@lo:104: Request processed in 89us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969536.583539:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1783969536.583572:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969536.583582:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60ee00/0xbacf56d076fabdfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076fabe04 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.583589:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60ee00 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:2.0:1783969536.583593:0:14152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60ee00/0xbacf56d076fabdfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076fabe04 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.583601:0:14152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60ee00/0xbacf56d076fabdfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076fabe04 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783969536.583609:0:14152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60ee00/0xbacf56d076fabdfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076fabe04 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969536.583615:0:14152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783969536.583657:0:14152:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60ee00/0xbacf56d076fabdfd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076fabe04 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.583665:0:14152:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783969536.583685:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60ee00/0xbacf56d076fabdfd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076fabe04 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.583692:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60ee00/0xbacf56d076fabdfd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076fabe04 expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.583710:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969536.583712:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969536.583714:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969536.583734:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c75a22f-689e-4536-9c19-8125b0e8c51a:3287:1870627280607104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783969536.583765:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969536.583820:0:14149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280607104 00000100:00100000:2.0:1783969536.583824:0:14149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280607104 00010000:00010000:2.0:1783969536.583843:0:14149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac786098000/0xbacf56d076fabe04 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076fabdfd expref: 12 pid: 14155 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969536.583891:0:14149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783969536.583898:0:14149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c75a22f-689e-4536-9c19-8125b0e8c51a+12:3287:x1870627280607104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783969536.583908:0:14149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969536.583913:0:14149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac786098000/0xbacf56d076fabe04 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076fabdfd expref: 12 pid: 14155 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.583923:0:14149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac786098000/0xbacf56d076fabe04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076fabdfd expref: 12 pid: 14155 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.583950:0:14149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ac783de6200/0xbacf56d076fabe43 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.583958:0:14149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac783de6200/0xbacf56d076fabe43 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.583971:0:14149:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac783de6200/0xbacf56d076fabe43 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.583978:0:14149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac783de6200/0xbacf56d076fabe43 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.583985:0:14149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac783de6200/0xbacf56d076fabe43 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.583992:0:14149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac783de6200/0xbacf56d076fabe43 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.584007:0:14149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6200 already unused, calling callback (ffffffffc1485230) 00010000:00010000:2.0:1783969536.584011:0:14149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac783de6200/0xbacf56d076fabe43 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.584018:0:14149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac783de6200/0xbacf56d076fabe43 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.584026:0:14149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac783de6200/0xbacf56d076fabe43 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969536.584036:0:14149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969536.584067:0:14149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c75a22f-689e-4536-9c19-8125b0e8c51a+12:3287:x1870627280607104:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969536.584074:0:14149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783969536.584109:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c75a22f-689e-4536-9c19-8125b0e8c51a:3287:1870627280607104:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783969536.584304:0:14594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac786098000/0xbacf56d076fabe04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076fabdfd expref: 11 pid: 14155 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969536.584317:0:14594:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785316a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14594:1870627280606976:0@lo:104: 00010000:00010000:0.0:1783969536.584343:0:14594:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ac783de6200/0xbacf56d076fabe43 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.584351:0:14594:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ac783de6200/0xbacf56d076fabe43 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.584357:0:14594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac783de6200/0xbacf56d076fabe43 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969536.584363:0:14594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac783de6200/0xbacf56d076fabe43 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969536.812745:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783969537.638647:0:14160:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783969537.638655:0:14160:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ac7c1809000 from 10 10000000:01000000:1.0:1783969537.638660:0:14160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783969537.638703:0:14160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e000/0xbacf56d076fabe4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969537.638715:0:14160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e000/0xbacf56d076fabe4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969537.638726:0:14160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e000/0xbacf56d076fabe4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969537.638755:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280607232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783969537.638820:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969537.638885:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7855e8600 going to sleep for 11 seconds 00000100:00100000:0.0:1783969537.639100:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280607232 00000100:00100000:0.0:1783969537.639108:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280607232 00000100:00100000:0.0:1783969537.639163:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783969537.639171:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7883c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+11:14160:x1870627280607232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969537.639184:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969537.639198:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7bfb92800/0xbacf56d076fabe51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076fabe4a expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969537.639218:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7bfb92800/0xbacf56d076fabe51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076fabe4a expref: 12 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969537.639228:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7bfb92800/0xbacf56d076fabe51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fabe4a expref: 12 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969537.639236:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92800, rc 0) 00000100:00100000:0.0:1783969537.639272:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7883c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+12:14160:x1870627280607232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969537.639278:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783969537.639372:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280607232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783969537.639387:0:14160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e000/0xbacf56d076fabe4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabe51 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969537.639396:0:14160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e000/0xbacf56d076fabe4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076fabe51 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969537.639445:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280607360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969537.639476:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969537.639504:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7855e8600 going to sleep for 11 seconds 00000100:00100000:0.0:1783969537.639544:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280607360 00000100:00100000:0.0:1783969537.639548:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280607360 00000100:00100000:0.0:1783969537.639576:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783969537.639582:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7883c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+12:14160:x1870627280607360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969537.639826:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7883c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+12:14160:x1870627280607360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969537.639833:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783969537.640107:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280607360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969537.640135:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280607488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969537.640173:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969537.640191:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7855e8600 going to sleep for 11 seconds 00000100:00100000:2.0:1783969537.640350:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280607488 00000100:00100000:2.0:1783969537.640356:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280607488 00000100:00100000:2.0:1783969537.640390:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783969537.640397:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7883c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+12:14160:x1870627280607488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969537.640562:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7883c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+12:14160:x1870627280607488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969537.640568:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783969537.640695:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280607488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783969537.642716:0:14653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1783969537.642820:0:14160:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1783969537.642841:0:14160:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783969537.642935:0:14160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e000/0xbacf56d076fabe4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabe51 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969537.642957:0:14160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e000/0xbacf56d076fabe4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabe51 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969537.830919:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969538.155539:0:3284:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783969528/real 1783969528] req@ffff9ac7bf6b3800 x1870627280604160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969538 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969538.155568:0:3284:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ac7bf6b3800 x1870627280604160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969538 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969538.155579:0:3284:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783969528/real 1783969528] req@ffff9ac7bf6b2680 x1870627280603904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969538 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969538.155589:0:3284:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ac7bf6b2680 x1870627280603904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969538 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783969538.155624:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9ac7c04f7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783969538.155646:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783969538.155650:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1870627280604160:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1783969538.155655:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9ac791bb0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783969538.155660:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783969538.155662:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1870627280603904:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1783969538.155796:0:483:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783969538.155809:0:483:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783969538.155811:0:483:0:(import.c:65:import_set_state_nolock()) ffff9ac791bb0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783969538.155816:0:483:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 386 00000100:00080000:0.0:1783969538.155821:0:483:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783969538.155827:0:483:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ac791bb0000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783969538.155848:0:483:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac7bf6b2680 x1870627280607744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783969538.155881:0:483:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783969538.155885:0:483:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783969538.155887:0:483:0:(import.c:65:import_set_state_nolock()) ffff9ac7c04f7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783969538.155900:0:483:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 386 00000100:00080000:0.0:1783969538.155903:0:483:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783969538.155907:0:483:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ac7c04f7000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783969538.155918:0:483:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac7bf6b3800 x1870627280607872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783969538.155951:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783969538.155962:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1870627280608000:0@lo:400:kworker.0 00000100:00100000:0.0:1783969538.156027:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969538.156137:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c75a22f-689e-4536-9c19-8125b0e8c51a:3288:1870627280607616:0@lo:400:kworker.0 00000100:00100000:2.0:1783969538.156172:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969538.156376:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280607616 00000100:00100000:0.0:1783969538.156383:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280607616 00000100:00100000:0.0:1783969538.156435:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783969538.156444:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7883c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+12:3288:x1870627280607616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969538.156497:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7883c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+12:3288:x1870627280607616:12345-0@lo:400:kworker.0 Request processed in 54us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969538.156504:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783969538.156556:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c75a22f-689e-4536-9c19-8125b0e8c51a:3288:1870627280607616:0@lo:400:kworker.0 00000100:00100000:1.0:1783969538.156728:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280608000 00000100:00100000:1.0:1783969538.156733:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280608000 00000100:00100000:1.0:1783969538.156768:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783969538.156775:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1870627280608000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969538.156826:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1870627280608000:12345-0@lo:400:kworker.0 Request processed in 51us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969538.156833:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783969538.156853:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1870627280607744:0@lo:8:kworker.0 00000400:00000100:1.0:1783969538.156905:0:3284:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870627280607744 offset 0 length 520: 4 00000100:00100000:1.0:1783969538.156919:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1870627280607872:0@lo:8:kworker.0 00000400:00000100:1.0:1783969538.156931:0:3284:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870627280607872 offset 0 length 520: 4 00010000:00080000:2.0:1783969538.157064:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ac7bf6b0a80 x1870627280608000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969538.157075:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1870627280608000:0@lo:400:kworker.0 00010000:00010000:1.0:1783969538.853030:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969539.877725:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783969540.460768:0:14795:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1783969540.460773:0:14795:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1783969540.461152:0:14795:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9ac786169000 00000020:01000004:2.0:1783969540.461167:0:14795:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1783969540.461179:0:14795:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1783969540.461191:0:14795:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ac7ba653380) 00000020:00000080:2.0:1783969540.461205:0:14795:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1783969540.488934:0:14795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1783969540.489207:0:14795:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1783969540.489965:0:14795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1783969540.490206:0:14795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1783969540.490424:0:14795:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1783969540.490757:0:14795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 707: rc = 0 00100000:10000000:3.0:1783969540.490856:0:14795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 707: rc = 0 00100000:10000000:3.0:1783969540.491055:0:14795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 707: rc = 0 00100000:10000000:3.0:1783969540.496503:0:14795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 387: rc = 0 00100000:10000000:3.0:1783969540.497387:0:14795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 387: rc = 0 00100000:10000000:3.0:1783969540.500184:0:14795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 387: rc = 0 00100000:10000000:3.0:1783969540.500558:0:14795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 387: rc = 0 00100000:10000000:1.0:1783969540.505089:0:14795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 387: rc = 0 00100000:10000000:1.0:1783969540.505405:0:14795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 387: rc = 0 00000020:00000080:1.0:1783969540.505944:0:14795:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1783969540.505954:0:14795:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783969540.505964:0:14795:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbacf56d076fabe5f 00000020:01000004:1.0:1783969540.505971:0:14795:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1783969540.505990:0:14795:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.139@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783969540.505993:0:14795:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783969540.505999:0:14795:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1783969540.506003:0:14795:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1783969540.506015:0:14795:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ac7b6430000) 00000020:00000080:1.0:1783969540.506025:0:14795:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1783969540.507086:0:14795:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783969540.507223:0:14795:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1783969540.507229:0:14795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1783969540.512404:0:14795:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1783969540.512423:0:14795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1783969540.517338:0:14795:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1783969540.517352:0:14795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1783969540.519313:0:14795:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783969540.519463:0:14795:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1783969540.519468:0:14795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1783969540.521412:0:14795:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1783969540.521424:0:14795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1783969540.539693:0:14795:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783969540.540152:0:14795:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783969540.540159:0:14795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1783969540.541593:0:14795:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1783969540.541604:0:14795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1783969540.542477:0:14795:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783969540.542485:0:14795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1783969540.544796:0:14795:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783969540.545230:0:14795:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1783969540.545242:0:14795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1783969540.546053:0:14795:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1783969540.546062:0:14795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1783969540.594446:0:14795:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783969540.594696:0:14795:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1783969540.594703:0:14795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1783969540.596590:0:14795:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1783969540.596602:0:14795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1783969540.597448:0:14795:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1783969540.597478:0:14795:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1783969540.597484:0:14795:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.139@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1783969540.627729:0:14795:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.139@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783969540.627782:0:14795:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.139@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1783969540.627787:0:14795:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783969540.627789:0:14795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783969540.627790:0:14795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969540.627792:0:14795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969540.627793:0:14795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969540.627794:0:14795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969540.627796:0:14795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783969540.627798:0:14795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969540.627799:0:14795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783969540.627802:0:14795:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1783969540.627804:0:14795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783969540.627806:0:14795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783969540.627807:0:14795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969540.627808:0:14795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969540.627809:0:14795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969540.627810:0:14795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969540.627811:0:14795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783969540.627812:0:14795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969540.627813:0:14795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783969540.627839:0:14795:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783969540.627929:0:14795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280608128:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783969540.628001:0:14795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969540.628055:0:14795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac798c55780 going to sleep for 11 seconds 00000100:00100000:3.0:1783969540.629521:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280608128 00000100:00100000:3.0:1783969540.629532:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280608128 00000100:00100000:3.0:1783969540.629624:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783969540.629644:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7883c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+12:14795:x1870627280608128:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783969540.629676:0:14157:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783969540.629680:0:14157:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1783969540.629684:0:14157:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1783969540.640823:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7883c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+12:14795:x1870627280608128:12345-0@lo:253:mount.lustre.0 Request processed in 11172us (12811us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969540.640837:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783969540.644044:0:14795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280608128:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783969540.644061:0:14795:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783969540.644080:0:14795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783969540.644082:0:14795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783969540.644083:0:14795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783969540.644084:0:14795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783969540.644086:0:14795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783969540.644087:0:14795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783969540.644088:0:14795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783969540.644090:0:14795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783969540.644091:0:14795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783969540.644214:0:14795:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ac786169000 from lustre-OST0000 10000000:01000000:3.0:1783969540.644247:0:14795:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1783969540.644251:0:14795:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1783969540.644258:0:14795:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ac7ba650000 local copy 00010000:00010000:3.0:1783969540.644269:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de7a00/0xbacf56d076fabd55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabd5c expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969540.644562:0:14795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785315f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280608256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969540.646466:0:14795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969540.646608:0:14795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac798f95300 going to sleep for 11 seconds 00000100:00100000:2.0:1783969540.646766:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280608256 00000100:00100000:2.0:1783969540.646774:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280608256 00000100:00100000:3.0:1783969540.647171:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783969540.647183:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7883c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+12:14795:x1870627280608256:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969540.647482:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7883c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+12:14795:x1870627280608256:12345-0@lo:501:mount.lustre.0 Request processed in 301us (1020us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783969540.647492:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783969540.647584:0:14795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785315f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280608256:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1783969540.647627:0:14795:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783969540.647797:0:14795:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783969540.647805:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de7a00/0xbacf56d076fabd55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabd5c expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969540.647817:0:14795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac783de7a00/0xbacf56d076fabd55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabd5c expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969540.647887:0:14795:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ac786169000 10000000:01000000:1.0:1783969540.647908:0:14795:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783969540.647914:0:14795:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ac7ba650000 10000000:01000000:1.0:1783969540.647917:0:14795:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1783969540.647920:0:14795:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9ac7ba650000 from 1 10000000:01000000:1.0:1783969540.647923:0:14795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1783969540.647953:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e600/0xbacf56d076fabe6d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969540.647962:0:14795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e600/0xbacf56d076fabe6d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969540.647971:0:14795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e600/0xbacf56d076fabe6d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969540.647990:0:14795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280608384:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783969540.648027:0:14795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969540.648517:0:14795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b5224c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783969540.648696:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280608384 00000100:00100000:0.0:1783969540.648702:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280608384 00000100:00100000:0.0:1783969540.648734:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783969540.648742:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7883c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+12:14795:x1870627280608384:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783969540.648754:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969540.648768:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7bfb92a00/0xbacf56d076fabe74 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076fabe6d expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969540.648789:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7bfb92a00/0xbacf56d076fabe74 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076fabe6d expref: 13 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969540.648800:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7bfb92a00/0xbacf56d076fabe74 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fabe6d expref: 13 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969540.648809:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92a00, rc 0) 00000100:00100000:0.0:1783969540.648993:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7883c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+13:14795:x1870627280608384:12345-0@lo:101:mount.lustre.0 Request processed in 250us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969540.649000:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783969540.649250:0:14795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280608384:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783969540.649267:0:14795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e600/0xbacf56d076fabe6d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabe74 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969540.649365:0:14795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e600/0xbacf56d076fabe6d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076fabe74 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969540.649388:0:14795:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1783969540.649443:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e600/0xbacf56d076fabe6d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabe74 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969540.649451:0:14795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e600/0xbacf56d076fabe6d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabe74 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969540.649458:0:14795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1783969540.649462:0:14795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783969540.649467:0:14795:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1783969540.649469:0:14795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783969540.649490:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f800/0xbacf56d076fabe7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969540.649496:0:14795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f800/0xbacf56d076fabe7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969540.649502:0:14795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f800/0xbacf56d076fabe7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969540.649516:0:14795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280608512:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783969540.649548:0:14795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969540.649579:0:14795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b5224c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783969540.649753:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280608512 00000100:00100000:0.0:1783969540.649758:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280608512 00000100:00100000:0.0:1783969540.649795:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783969540.649808:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7883c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+13:14795:x1870627280608512:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783969540.649818:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969540.649826:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7bfb92600/0xbacf56d076fabe82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076fabe7b expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969540.649841:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7bfb92600/0xbacf56d076fabe82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076fabe7b expref: 14 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969540.649989:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7bfb92600/0xbacf56d076fabe82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fabe7b expref: 14 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969540.649998:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92600, rc 0) 00000100:00100000:0.0:1783969540.650029:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7883c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+14:14795:x1870627280608512:12345-0@lo:101:mount.lustre.0 Request processed in 221us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969540.650035:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783969540.650112:0:14795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280608512:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783969540.650124:0:14795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f800/0xbacf56d076fabe7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabe82 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969540.650137:0:14795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f800/0xbacf56d076fabe7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076fabe82 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783969540.651226:0:14795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1783969540.652907:0:14795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783969540.653162:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1783969540.653207:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1783969540.653237:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1783969540.653280:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1783969540.653342:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1783969540.653373:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1783969540.653430:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1783969540.653437:0:14795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1783969540.653513:0:14795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280608640:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783969540.653570:0:14795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969540.653615:0:14795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b5224900 going to sleep for 11 seconds 00000100:00100000:3.0:1783969540.653882:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280608640 00000100:00100000:3.0:1783969540.653888:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280608640 00000100:00100000:3.0:1783969540.653931:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783969540.653947:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+14:14795:x1870627280608640:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969540.654278:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+14:14795:x1870627280608640:12345-0@lo:501:mount.lustre.0 Request processed in 331us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969540.654307:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783969540.654709:0:14795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280608640:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783969540.654752:0:14795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280608768:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783969540.654796:0:14795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969540.655088:0:14795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b5224900 going to sleep for 11 seconds 00000100:00100000:0.0:1783969540.655291:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280608768 00000100:00100000:0.0:1783969540.655307:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280608768 00000100:00100000:0.0:1783969540.655346:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783969540.655352:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+14:14795:x1870627280608768:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783969540.656102:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+14:14795:x1870627280608768:12345-0@lo:503:mount.lustre.0 Request processed in 745us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969540.656111:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783969540.656199:0:14795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280608768:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783969540.656995:0:14795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783969540.657067:0:14795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280608896:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783969540.657124:0:14795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969540.657209:0:14795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b5224900 going to sleep for 11 seconds 00000100:00100000:0.0:1783969540.657358:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280608896 00000100:00100000:0.0:1783969540.657365:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280608896 00000100:00100000:0.0:1783969540.657440:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783969540.657448:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+14:14795:x1870627280608896:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783969540.658189:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+14:14795:x1870627280608896:12345-0@lo:502:mount.lustre.0 Request processed in 739us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969540.658208:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783969540.658977:0:14795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280608896:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783969540.659279:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1783969540.659429:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1783969540.659463:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1783969540.659508:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1783969540.659545:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1783969540.659576:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1783969540.659758:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1783969540.659803:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1783969540.659840:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1783969540.661581:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1783969540.661733:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1783969540.661782:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1783969540.661831:0:14795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280609024:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783969540.661938:0:14795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969540.661972:0:14795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b5224900 going to sleep for 11 seconds 00000100:00100000:0.0:1783969540.662893:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280609024 00000100:00100000:0.0:1783969540.662903:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280609024 00000100:00100000:0.0:1783969540.662963:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783969540.662973:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+14:14795:x1870627280609024:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783969540.663207:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+14:14795:x1870627280609024:12345-0@lo:502:mount.lustre.0 Request processed in 235us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969540.663216:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783969540.669197:0:14795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280609024:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783969540.669388:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1783969540.669406:0:14795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1783969540.675760:0:14809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783969540.675772:0:14809:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1783969540.675779:0:14809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783969540.675781:0:14809:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1783969540.675789:0:14809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783969540.675803:0:14809:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ac7ba654d40) 00000020:00000080:2.0:1783969540.675830:0:14809:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783969540.675837:0:14809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783969540.675915:0:14809:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac786169000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1783969540.675922:0:14809:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783969540.675930:0:14809:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbacf56d076fabe90 00010000:00010000:2.0:1783969540.678999:0:14809:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1783969540.680581:0:14809:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1783969540.688188:0:14809:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1783969540.690584:0:14809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1783969540.690596:0:14809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969540.690674:0:14809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969540.690677:0:14809:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1783969540.690682:0:14809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783969540.690686:0:14809:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1783969540.690687:0:14809:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783969540.690689:0:14809:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783969540.690691:0:14809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783969540.690693:0:14809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969540.690694:0:14809:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783969540.690697:0:14809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969540.690700:0:14809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969540.690702:0:14809:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783969540.690705:0:14809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783969540.690707:0:14809:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783969540.690709:0:14809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969540.690712:0:14809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969540.690713:0:14809:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783969540.690716:0:14809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969540.690718:0:14809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969540.690720:0:14809:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783969540.690723:0:14809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1783969540.690791:0:14809:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969540.690795:0:14809:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969540.690796:0:14809:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783969540.690799:0:14809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1783969540.692701:0:14795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1783969540.692744:0:14795:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783969540.692813:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f800/0xbacf56d076fabe7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabe82 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969540.692827:0:14795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f800/0xbacf56d076fabe7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabe82 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969540.693388:0:14795:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ac786169000 from 1 10000000:01000000:0.0:1783969540.693392:0:14795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783969540.693431:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93400/0xbacf56d076fabe97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969540.693440:0:14795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93400/0xbacf56d076fabe97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969540.693451:0:14795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93400/0xbacf56d076fabe97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969540.693486:0:14795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280609152:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783969540.693549:0:14795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969540.693592:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280609152 00000100:00100000:0.0:1783969540.693610:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280609152 00000100:00100000:0.0:1783969540.693651:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783969540.693660:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+14:14795:x1870627280609152:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783969540.693672:0:14158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969540.693685:0:14158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7bfb93200/0xbacf56d076fabe9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076fabe97 expref: -99 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969540.693708:0:14158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7bfb93200/0xbacf56d076fabe9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076fabe97 expref: 15 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969540.693718:0:14158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7bfb93200/0xbacf56d076fabe9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fabe97 expref: 15 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969540.693740:0:14158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93200, rc 0) 00000100:00100000:0.0:1783969540.693772:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+15:14795:x1870627280609152:12345-0@lo:101:mount.lustre.0 Request processed in 112us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969540.693778:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783969540.693824:0:14795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac788af5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783969540.693847:0:14795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280609152:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783969540.693882:0:14795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93400/0xbacf56d076fabe97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabe9e expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969540.693891:0:14795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93400/0xbacf56d076fabe97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076fabe9e expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783969540.694772:0:14795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1783969540.695201:0:14795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783969540.697153:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1783969540.697230:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1783969540.698021:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1783969540.698034:0:14795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1783969540.698132:0:14795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280609280:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783969540.698195:0:14795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969540.698240:0:14795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7877cdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1783969540.698699:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280609280 00000100:00100000:2.0:1783969540.698707:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280609280 00000100:00100000:2.0:1783969540.698754:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783969540.698765:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+15:14795:x1870627280609280:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783969540.700542:0:14795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280609280:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783969540.700590:0:14795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280609408:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783969540.701583:0:14795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969540.701648:0:14795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7877cdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969540.701900:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280609408 00000100:00100000:1.0:1783969540.701907:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280609408 00000100:00100000:1.0:1783969540.701947:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783969540.701963:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:14795:x1870627280609408:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783969540.702155:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:14795:x1870627280609408:12345-0@lo:503:mount.lustre.0 Request processed in 192us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969540.702163:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783969540.703151:0:14795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280609408:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783969540.703608:0:14795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783969540.703676:0:14795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280609536:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783969540.703725:0:14795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969540.703763:0:14795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7877cdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783969540.705113:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280609536 00000100:00100000:3.0:1783969540.705122:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280609536 00000100:00100000:3.0:1783969540.705173:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783969540.705181:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:14795:x1870627280609536:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783969540.705387:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:14795:x1870627280609536:12345-0@lo:502:mount.lustre.0 Request processed in 206us (1659us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969540.705394:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783969540.706391:0:14795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280609536:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783969540.706670:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1783969540.706718:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1783969540.706759:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1783969540.706796:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1783969540.706915:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1783969540.706975:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1783969540.707010:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1783969540.707046:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1783969540.707085:0:14795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280609664:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783969540.707208:0:14795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969540.707229:0:14795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7877cdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783969540.707788:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280609664 00000100:00100000:3.0:1783969540.707795:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280609664 00000100:00100000:3.0:1783969540.707848:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783969540.707874:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:14795:x1870627280609664:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783969540.708079:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:14795:x1870627280609664:12345-0@lo:502:mount.lustre.0 Request processed in 223us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969540.708087:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783969540.708230:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+15:14795:x1870627280609280:12345-0@lo:501:mount.lustre.0 Request processed in 9465us (10033us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969540.708237:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783969540.708584:0:14795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280609664:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783969540.708758:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1783969540.708771:0:14795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1783969540.710718:0:14813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969540.710728:0:14813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969540.710730:0:14813:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783969540.710737:0:14813:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac786169000 00000020:00000080:0.0:1783969540.710739:0:14813:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783969540.710746:0:14813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969540.710748:0:14813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969540.710749:0:14813:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783969540.710752:0:14813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969540.710766:0:14813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969540.710768:0:14813:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783969540.710771:0:14813:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac786169000 00000020:00000080:0.0:1783969540.710773:0:14813:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783969540.711057:0:14813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969540.711073:0:14813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969540.711075:0:14813:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783969540.711078:0:14813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969540.711081:0:14813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969540.711082:0:14813:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783969540.711086:0:14813:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ac786169000 00000020:00000080:0.0:1783969540.711088:0:14813:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783969540.711129:0:14813:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969540.711132:0:14813:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969540.711134:0:14813:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783969540.711137:0:14813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1783969540.711936:0:14795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1783969540.711965:0:14795:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783969540.712017:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93400/0xbacf56d076fabe97 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabe9e expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969540.712039:0:14795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93400/0xbacf56d076fabe97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabe9e expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969540.712086:0:14795:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783969540.712090:0:14795:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ac786169000 10000000:01000000:2.0:1783969540.712094:0:14795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ac786169000 10000000:01000000:2.0:1783969540.712098:0:14795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783969540.712104:0:14795:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ac786169000 from 1 10000000:01000000:2.0:1783969540.712107:0:14795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783969540.712142:0:14795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac786098a00/0xbacf56d076fabea5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969540.712150:0:14795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac786098a00/0xbacf56d076fabea5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969540.712159:0:14795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac786098a00/0xbacf56d076fabea5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969540.712182:0:14795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280609792:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783969540.712246:0:14795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969540.712310:0:14795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac798c55900 going to sleep for 11 seconds 00000100:00100000:0.0:1783969540.714414:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280609792 00000100:00100000:0.0:1783969540.714427:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280609792 00000100:00100000:0.0:1783969540.714492:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783969540.714502:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+15:14795:x1870627280609792:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783969540.714516:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969540.714532:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7bfb93a00/0xbacf56d076fabeac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076fabea5 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969540.714558:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7bfb93a00/0xbacf56d076fabeac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076fabea5 expref: 16 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969540.714569:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7bfb93a00/0xbacf56d076fabeac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fabea5 expref: 16 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969540.714579:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93a00, rc 0) 00000100:00100000:0.0:1783969540.714664:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:14795:x1870627280609792:12345-0@lo:101:mount.lustre.0 Request processed in 165us (2418us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969540.714679:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783969540.714937:0:14795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280609792:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783969540.714957:0:14795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac786098a00/0xbacf56d076fabea5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabeac expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969540.714966:0:14795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac786098a00/0xbacf56d076fabea5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076fabeac expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783969540.715726:0:14795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1783969540.716332:0:14795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783969540.716625:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1783969540.720393:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1783969540.720586:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1783969540.720795:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1783969540.720836:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1783969540.720925:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1783969540.720965:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1783969540.721001:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1783969540.721067:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1783969540.721108:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1783969540.721144:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1783969540.721196:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1783969540.721235:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1783969540.721271:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1783969540.721334:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1783969540.721369:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1783969540.721402:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1783969540.721452:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1783969540.722822:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1783969540.722885:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1783969540.722951:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1783969540.723006:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1783969540.723043:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1783969540.723091:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1783969540.723128:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1783969540.723162:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1783969540.723227:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1783969540.723270:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1783969540.727489:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1783969540.727520:0:14795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1783969540.727628:0:14795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280609920:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783969540.727895:0:14795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969540.727935:0:14795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac798c55900 going to sleep for 11 seconds 00000100:00100000:0.0:1783969540.728035:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280609920 00000100:00100000:0.0:1783969540.728042:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280609920 00000100:00100000:0.0:1783969540.728086:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783969540.728094:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:14795:x1870627280609920:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783969540.728499:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:14795:x1870627280609920:12345-0@lo:501:mount.lustre.0 Request processed in 404us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969540.728507:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783969540.734405:0:14795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280609920:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783969540.734478:0:14795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280610048:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783969540.734549:0:14795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969540.734586:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280610048 00000100:00100000:2.0:1783969540.734593:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280610048 00000100:00100000:2.0:1783969540.734646:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783969540.734656:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:14795:x1870627280610048:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783969540.734839:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:14795:x1870627280610048:12345-0@lo:503:mount.lustre.0 Request processed in 183us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969540.734846:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783969540.734917:0:14795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac798c55900 going to sleep for 11 seconds 00000100:00100000:2.0:1783969540.734932:0:14795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280610048:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783969540.735442:0:14795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783969540.735504:0:14795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280610176:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783969540.735545:0:14795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969540.735574:0:14795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac798c55900 going to sleep for 11 seconds 00000100:00100000:2.0:1783969540.737559:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280610176 00000100:00100000:2.0:1783969540.737569:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280610176 00000100:00100000:2.0:1783969540.737627:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783969540.738595:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:14795:x1870627280610176:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783969540.738926:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:14795:x1870627280610176:12345-0@lo:502:mount.lustre.0 Request processed in 1290us (3379us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969540.738940:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783969540.739011:0:14795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280610176:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783969540.739252:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1783969540.740793:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1783969540.740856:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1783969540.740943:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1783969540.740983:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1783969540.741048:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1783969540.741085:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1783969540.741120:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1783969540.741168:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1783969540.741205:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1783969540.741240:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1783969540.745518:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1783969540.749999:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1783969540.750128:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1783969540.750206:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1783969540.750245:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1783969540.750304:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1783969540.750355:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1783969540.750391:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1783969540.750428:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1783969540.750480:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1783969540.750544:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1783969540.750578:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1783969540.750819:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1783969540.750895:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1783969540.750936:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1783969540.750986:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1783969540.751023:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1783969540.751066:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1783969540.751112:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1783969540.751151:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1783969540.751186:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1783969540.751221:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1783969540.751424:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1783969540.751468:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1783969540.751516:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1783969540.751553:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1783969540.751928:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1783969540.751990:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1783969540.752029:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1783969540.752079:0:14795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280610304:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783969540.752156:0:14795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969540.752207:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280610304 00000100:00100000:2.0:1783969540.752213:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280610304 00000100:00100000:2.0:1783969540.752368:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783969540.752379:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:14795:x1870627280610304:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783969540.752593:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:14795:x1870627280610304:12345-0@lo:502:mount.lustre.0 Request processed in 215us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969540.754776:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783969540.762733:0:14795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac798c55900 going to sleep for 11 seconds 00000100:00100000:3.0:1783969540.762780:0:14795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280610304:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783969540.762936:0:14795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1783969540.762951:0:14795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1783969540.767821:0:14818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1783969540.767839:0:14818:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ac7917f3380) 00000020:00000080:0.0:1783969540.767926:0:14818:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1783969540.768129:0:14818:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac786169000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783969540.768134:0:14818:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ac786169000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783969540.768137:0:14818:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac786169000 3 00010000:00080000:0.0:1783969540.768166:0:14818:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ac79e0fe800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.139@tcp at head 00010000:00010000:0.0:1783969540.770440:0:14818:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1783969540.770707:0:14818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1783969540.770745:0:14818:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783969540.770757:0:14818:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xbacf56d076fabeba 00000100:00080000:0.0:1783969540.770768:0:14818:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783969540.770774:0:14818:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ac79e0fe800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1783969540.770810:0:14818:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac7bf6b0000 x1870627280610432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783969540.770934:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3284:1870627280610432:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783969540.771003:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969540.771108:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280610432 00000100:00100000:2.0:1783969540.771115:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280610432 00000100:00100000:2.0:1783969540.771148:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783969540.771156:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3284:x1870627280610432:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783969540.771178:0:14162:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 397 last 0 00000020:00000080:2.0:1783969540.771206:0:14162:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xbacf56d076fabec1 00000004:00100000:2.0:1783969540.771220:0:14162:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783969540.771248:0:14162:0:(import.c:65:import_set_state_nolock()) ffff9ac7861da800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1783969540.771362:0:14818:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783969540.774625:0:483:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783969540.774634:0:483:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783969540.774652:0:483:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783969540.774655:0:483:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783969540.776452:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1870627280610560:0@lo:400:kworker.0 00000100:00100000:3.0:1783969540.776530:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969540.777701:0:14164:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783969540.777715:0:14164:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1783969540.777843:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280610560 00000100:00100000:0.0:1783969540.777856:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280610560 00000100:00100000:0.0:1783969540.777919:0:14164:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783969540.777931:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783969540.777939:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1870627280610560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969540.778012:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1870627280610560:12345-0@lo:400:kworker.0 Request processed in 73us (1481us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969540.778019:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783969540.778063:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ac785316300 x1870627280610560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969540.778078:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3286:1870627280610560:0@lo:400:kworker.0 00000040:00080000:0.0:1783969540.783716:0:14818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1783969540.784089:0:14795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1783969540.784121:0:14795:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783969540.784137:0:14795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac786098a00/0xbacf56d076fabea5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabeac expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969540.784149:0:14795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac786098a00/0xbacf56d076fabea5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabeac expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783969540.784202:0:14795:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783969540.784204:0:14795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783969540.784206:0:14795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783969540.784207:0:14795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783969540.784208:0:14795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783969540.784210:0:14795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783969540.784211:0:14795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783969540.784213:0:14795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783969540.784214:0:14795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783969540.784217:0:14795:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1783969540.784220:0:14795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783969540.784221:0:14795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783969540.784222:0:14795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783969540.784223:0:14795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783969540.784224:0:14795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783969540.784225:0:14795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783969540.784226:0:14795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783969540.784227:0:14795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783969540.784228:0:14795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783969540.784252:0:14795:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1783969540.784272:0:14795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785315c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280610688:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783969540.784372:0:14795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969540.784414:0:14795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7885bb600 going to sleep for 11 seconds 00000100:00100000:2.0:1783969540.785998:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3284:x1870627280610432:12345-0@lo:38:llog_process_th.0 Request processed in 14833us (14985us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969540.786012:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783969540.786045:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280610688 00000100:00100000:2.0:1783969540.786053:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280610688 00000100:00100000:2.0:1783969540.786095:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783969540.786104:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:14795:x1870627280610688:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783969540.786132:0:14157:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783969540.786145:0:14157:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1783969540.786846:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ac7bf6b0000 x1870627280610432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783969550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969540.786961:0:3284:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783969540.786971:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1783969540.786978:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783969540.786983:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783969540.786986:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9ac79e0fe800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783969540.786994:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3284:1870627280610432:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1783969540.829787:0:14157:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783969540.829838:0:14157:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1783969540.830611:0:14178:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783969540.830617:0:14178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783969540.830639:0:14178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac7bfb92400/0xbacf56d076fabec8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969540.830657:0:14178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac7bf60e200/0xbacf56d076fabe35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fabe2e expref: 16 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969540.830665:0:14178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ac7bfb92400/0xbacf56d076fabec8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969540.830703:0:14178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac7bf60e200/0xbacf56d076fabe35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076fabe2e expref: 16 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969540.830717:0:14178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac7bf60e200/0xbacf56d076fabe35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076fabe2e expref: 16 pid: 14158 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969540.830731:0:14178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b0380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14178:1870627280610816:0@lo:104: 00000100:00100000:0.0:1783969540.830808:0:14178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969540.830914:0:14178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac790e91f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783969540.831153:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280610816 00000100:00100000:3.0:1783969540.831160:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280610816 00000100:00100000:3.0:1783969540.831207:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783969540.831216:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c75a22f-689e-4536-9c19-8125b0e8c51a+3:14178:x1870627280610816:12345-0@lo:104: 00010000:00010000:3.0:1783969540.831228:0:14146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93c00/0xbacf56d076fabe2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076fabe35 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969540.831276:0:14146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783969540.831282:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c75a22f-689e-4536-9c19-8125b0e8c51a+3:14178:x1870627280610816:12345-0@lo:104: Request processed in 68us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969540.831289:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1783969540.831319:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969540.831325:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93c00/0xbacf56d076fabe2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076fabe35 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969540.831333:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93c00 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:3.0:1783969540.831336:0:14151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93c00/0xbacf56d076fabe2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076fabe35 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969540.831345:0:14151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93c00/0xbacf56d076fabe2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076fabe35 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969540.831352:0:14151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93c00/0xbacf56d076fabe2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076fabe35 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969540.831357:0:14151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783969540.831389:0:14151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93c00/0xbacf56d076fabe2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076fabe35 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969540.831395:0:14151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969540.831412:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93c00/0xbacf56d076fabe2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076fabe35 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969540.831419:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93c00/0xbacf56d076fabe2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076fabe35 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969540.831434:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969540.831436:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969540.831437:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969540.831471:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c75a22f-689e-4536-9c19-8125b0e8c51a:3287:1870627280610944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969540.831499:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969540.831549:0:14178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b0380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14178:1870627280610816:0@lo:104: 00010000:00010000:3.0:1783969540.831567:0:14178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ac7bfb92400/0xbacf56d076fabec8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969540.832032:0:14150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280610944 00000100:00100000:3.0:1783969540.832037:0:14150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280610944 00010000:00010000:3.0:1783969540.832060:0:14150:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac7bf60e200/0xbacf56d076fabe35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076fabe2e expref: 17 pid: 14158 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969540.832084:0:14150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783969540.832091:0:14150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785316680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c75a22f-689e-4536-9c19-8125b0e8c51a+17:3287:x1870627280610944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969540.832102:0:14150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969540.832107:0:14150:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac7bf60e200/0xbacf56d076fabe35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076fabe2e expref: 17 pid: 14158 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969540.832128:0:14150:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac7bf60e200/0xbacf56d076fabe35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076fabe2e expref: 17 pid: 14158 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969540.832141:0:14150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7bf60e200/0xbacf56d076fabe35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076fabe2e expref: 17 pid: 14158 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969540.832153:0:14150:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ac7bfb92400/0xbacf56d076fabec8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969540.832159:0:14150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7bfb92400/0xbacf56d076fabec8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783969540.832172:0:14150:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001554678s 00010000:00010000:3.0:1783969540.832176:0:14150:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac7bfb92400/0xbacf56d076fabec8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969540.832183:0:14150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac7bfb92400/0xbacf56d076fabec8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969540.832189:0:14150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac7bfb92400/0xbacf56d076fabec8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969540.832195:0:14150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac7bfb92400/0xbacf56d076fabec8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969540.832200:0:14150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92400 already unused, calling callback (ffffffffc1485230) 00010000:00010000:3.0:1783969540.832203:0:14150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac7bfb92400/0xbacf56d076fabec8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969540.832209:0:14150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac7bfb92400/0xbacf56d076fabec8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969540.832230:0:14150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac7bfb92400/0xbacf56d076fabec8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969540.832238:0:14150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969540.832276:0:14150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785316680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:3287:x1870627280610944:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969540.832284:0:14150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783969540.832331:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c75a22f-689e-4536-9c19-8125b0e8c51a:3287:1870627280610944:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969540.832348:0:14178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ac7bfb92400/0xbacf56d076fabec8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969540.832355:0:14178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac7bfb92400/0xbacf56d076fabec8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969540.832361:0:14178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7bfb92400/0xbacf56d076fabec8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969540.853668:0:14795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785315c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:14795:1870627280610688:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783969540.853671:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+15:14795:x1870627280610688:12345-0@lo:253:mount.lustre.0 Request processed in 67567us (69298us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969540.853682:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 10000000:01000000:3.0:1783969540.853686:0:14795:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1783969540.853689:0:14795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783969540.853690:0:14795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783969540.853691:0:14795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783969540.853692:0:14795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783969540.853694:0:14795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783969540.853695:0:14795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783969540.853696:0:14795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783969540.853697:0:14795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783969540.853699:0:14795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783969540.853712:0:14795:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783969540.862176:0:14795:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1783969540.862455:0:14795:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783969540.862631:0:14795:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1783969540.862935:0:14795:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783969540.863221:0:14795:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1783969540.863521:0:14795:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1783969540.865275:0:14795:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1783969540.901189:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1783969540.961267:0:14795:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1783969540.961277:0:14795:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1783969540.961351:0:14795:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783969540.961420:0:14795:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.139@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783969540.961437:0:14795:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1783969540.961469:0:14795:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00000040:00080000:3.0:1783969541.350015:0:14197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783969541.925243:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783969542.181051:0:14160:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783969542.181059:0:14160:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ac7c1809000 from 7 10000000:01000000:3.0:1783969542.181064:0:14160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783969542.181116:0:14160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de6400/0xbacf56d076fabecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969542.181127:0:14160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac783de6400/0xbacf56d076fabecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969542.181138:0:14160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac783de6400/0xbacf56d076fabecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969542.181164:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785315c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280611072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783969542.181365:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969542.181451:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfda6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783969542.184339:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280611072 00000100:00100000:2.0:1783969542.184353:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280611072 00000100:00100000:2.0:1783969542.184460:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783969542.184470:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+15:14160:x1870627280611072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969542.184494:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969542.184514:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac786098000/0xbacf56d076fabed6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076fabecf expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969542.184542:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac786098000/0xbacf56d076fabed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076fabecf expref: 16 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969542.184554:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac786098000/0xbacf56d076fabed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fabecf expref: 16 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969542.184562:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786098000, rc 0) 00000100:00100000:2.0:1783969542.184633:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:14160:x1870627280611072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (3268us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969542.184640:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783969542.187002:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785315c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280611072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783969542.187028:0:14160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac783de6400/0xbacf56d076fabecf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabed6 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969542.187041:0:14160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac783de6400/0xbacf56d076fabecf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076fabed6 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969542.187276:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785315c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280611200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783969542.187420:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969542.187461:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfda6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783969542.188516:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280611200 00000100:00100000:2.0:1783969542.188526:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280611200 00000100:00100000:2.0:1783969542.188586:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783969542.188945:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:14160:x1870627280611200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783969542.188968:0:14155:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783969542.188982:0:14155:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783969542.188985:0:14155:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1783969542.189355:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:14160:x1870627280611200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 413us (1934us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969542.189363:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783969542.189538:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785315c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280611200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783969542.189599:0:14160:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783969542.189613:0:14160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de6400/0xbacf56d076fabecf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabed6 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969542.189623:0:14160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac783de6400/0xbacf56d076fabecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabed6 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969542.953451:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969543.975452:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969544.998446:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783969545.831181:0:483:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969545.831188:0:483:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783969545.831191:0:483:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969545.831193:0:483:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783969545.831244:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c75a22f-689e-4536-9c19-8125b0e8c51a:3288:1870627280611328:0@lo:400:kworker.0 00000100:00100000:1.0:1783969545.831321:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969545.831397:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1870627280611456:0@lo:400:kworker.0 00000100:00100000:1.0:1783969545.831425:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969545.831452:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969545.831471:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280611584:0@lo:400:kworker.0 00000100:00100000:1.0:1783969545.831495:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969545.831531:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280611456 00000100:00100000:1.0:1783969545.831537:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280611456 00000100:00100000:1.0:1783969545.831575:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280611584 00000100:00100000:1.0:1783969545.831578:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280611584 00000100:00100000:1.0:1783969545.831607:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783969545.831614:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1870627280611456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969545.831663:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1870627280611456:12345-0@lo:400:kworker.0 Request processed in 49us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969545.831670:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783969545.831686:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783969545.831692:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280611584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969545.831720:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280611584:12345-0@lo:400:kworker.0 Request processed in 28us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969545.831726:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1783969545.831755:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783969545.831778:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac7c1bbe300 x1870627280611584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969545.831791:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280611584:0@lo:400:kworker.0 00010000:00080000:1.0:1783969545.831801:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac7c1bbd500 x1870627280611456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969545.831810:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1870627280611456:0@lo:400:kworker.0 00000100:00100000:2.0:1783969545.834367:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280611328 00000100:00100000:2.0:1783969545.834381:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280611328 00000100:00100000:2.0:1783969545.834436:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783969545.834445:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:3288:x1870627280611328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969545.834545:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:3288:x1870627280611328:12345-0@lo:400:kworker.0 Request processed in 100us (3222us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969545.834552:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783969545.834608:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c75a22f-689e-4536-9c19-8125b0e8c51a:3288:1870627280611328:0@lo:400:kworker.0 00010000:00010000:0.0:1783969546.022113:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969547.047266:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783969547.449822:0:15163:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783969548.069197:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969549.096985:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969550.119757:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969550.949158:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:0.0:1783969550.949285:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783969550.949291:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783969550.949294:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783969550.949297:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783969550.949344:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870627280611840:0@lo:400:kworker.0 00000100:00100000:2.0:1783969550.949405:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969550.949462:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c75a22f-689e-4536-9c19-8125b0e8c51a:3288:1870627280611712:0@lo:400:kworker.0 00000100:00100000:2.0:1783969550.949486:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969550.949523:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280611712 00000100:00100000:2.0:1783969550.949530:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280611712 00000100:00100000:1.0:1783969550.949623:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280611840 00000100:00100000:1.0:1783969550.949628:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280611840 00000100:00100000:1.0:1783969550.949680:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783969550.949688:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870627280611840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969550.949758:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870627280611840:12345-0@lo:400:kworker.0 Request processed in 71us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969550.949765:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783969550.950184:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783969550.950191:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:3288:x1870627280611712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969550.950226:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:3288:x1870627280611712:12345-0@lo:400:kworker.0 Request processed in 35us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969550.950241:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1783969550.950296:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac7bf6b2a00 x1870627280611840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969550.950309:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870627280611840:0@lo:400:kworker.0 00000100:00100000:2.0:1783969550.950319:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c75a22f-689e-4536-9c19-8125b0e8c51a:3288:1870627280611712:0@lo:400:kworker.0 00000100:00100000:0.0:1783969550.952089:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280611968:0@lo:400:kworker.0 00000100:00100000:0.0:1783969550.952147:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969550.952190:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280611968 00000100:00100000:0.0:1783969550.952196:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280611968 00000100:00100000:0.0:1783969550.952253:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783969550.952262:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280611968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969550.952309:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280611968:12345-0@lo:400:kworker.0 Request processed in 48us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969550.952316:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1783969550.952336:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783969550.952358:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac7bf6b1c00 x1870627280611968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783969550.952370:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280611968:0@lo:400:kworker.0 00010000:00010000:1.0:1783969551.141051:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783969551.591848:0:14197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783969552.167430:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969553.065305:0:3284:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783969538/real 1783969538] req@ffff9ac7bf6b2680 x1870627280607744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969553 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969553.065336:0:3284:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ac7bf6b2680 x1870627280607744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969553 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969553.065356:0:3284:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783969538/real 1783969538] req@ffff9ac7bf6b3800 x1870627280607872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969553 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969553.065370:0:3284:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ac7bf6b3800 x1870627280607872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783969553 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783969553.065386:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9ac791bb0000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783969553.065405:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783969553.065409:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1870627280607744:0@lo:8:kworker.0 00000100:00080000:2.0:1783969553.065414:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9ac7c04f7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783969553.065418:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783969553.065421:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1870627280607872:0@lo:8:kworker.0 00000100:00080000:3.0:1783969553.065856:0:483:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783969553.065880:0:483:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1783969553.065884:0:483:0:(import.c:65:import_set_state_nolock()) ffff9ac791bb0000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783969553.065889:0:483:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 395 00000100:00080000:3.0:1783969553.065895:0:483:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783969553.065902:0:483:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ac791bb0000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1783969553.065923:0:483:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac785315880 x1870627280612224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783969553.065936:0:483:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783969553.065939:0:483:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783969553.065941:0:483:0:(import.c:65:import_set_state_nolock()) ffff9ac7c04f7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783969553.065944:0:483:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 395 00000100:00080000:3.0:1783969553.065947:0:483:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1783969553.065950:0:483:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ac7c04f7000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1783969553.065963:0:483:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac785314700 x1870627280612352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783969553.066077:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c75a22f-689e-4536-9c19-8125b0e8c51a:3286:1870627280612096:0@lo:400:kworker.0 00000100:00100000:2.0:1783969553.066147:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969553.066234:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280612480:0@lo:400:kworker.0 00000100:00100000:2.0:1783969553.066263:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969553.066301:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783969553.066306:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280612608:0@lo:400:kworker.0 00000100:00100000:2.0:1783969553.066333:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969553.066367:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280612480 00000100:00100000:2.0:1783969553.066374:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280612480 00000100:00100000:2.0:1783969553.066410:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280612608 00000100:00100000:2.0:1783969553.066412:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280612608 00000100:00100000:2.0:1783969553.066437:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783969553.066445:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280612480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969553.066495:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280612480:12345-0@lo:400:kworker.0 Request processed in 50us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969553.066509:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783969553.066539:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783969553.066545:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280612608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969553.066577:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280612608:12345-0@lo:400:kworker.0 Request processed in 31us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969553.066681:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280612096 00000100:00100000:3.0:1783969553.066685:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280612096 00000100:00100000:3.0:1783969553.066727:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783969553.066733:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:3286:x1870627280612096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969553.066769:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:3286:x1870627280612096:12345-0@lo:400:kworker.0 Request processed in 36us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969553.066775:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783969553.067715:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1783969553.067750:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783969553.067800:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac785317800 x1870627280612608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969553.067815:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280612608:0@lo:400:kworker.0 00010000:00080000:2.0:1783969553.067831:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac785314380 x1870627280612480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969553.067840:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280612480:0@lo:400:kworker.0 00000100:00100000:2.0:1783969553.067900:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c75a22f-689e-4536-9c19-8125b0e8c51a:3286:1870627280612096:0@lo:400:kworker.0 00000100:00100000:2.0:1783969553.067923:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1870627280612224:0@lo:8:kworker.0 00000100:00100000:2.0:1783969553.067975:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969553.068017:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1870627280612352:0@lo:8:kworker.0 00000100:00100000:2.0:1783969553.068043:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969553.068131:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280612224 00000100:00100000:0.0:1783969553.068138:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280612224 00000100:00100000:0.0:1783969553.068158:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280612352 00000100:00100000:0.0:1783969553.068161:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280612352 00000100:00100000:0.0:1783969553.068172:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783969553.068178:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1beb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3284:x1870627280612224:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1783969553.068204:0:14798:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 410 last 0 00000020:00000080:0.0:1783969553.068242:0:14798:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbacf56d076fabedd 00002000:00100000:0.0:1783969553.068255:0:14798:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ac79e0f9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1783969553.068259:0:14798:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1783969553.068261:0:14798:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1783969553.068572:0:14798:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783969553.068595:0:14798:0:(import.c:65:import_set_state_nolock()) ffff9ac79e0ff000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783969553.068657:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1beb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3284:x1870627280612224:12345-0@lo:8:kworker.0 Request processed in 478us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969553.068666:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783969553.068681:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783969553.068685:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3284:x1870627280612352:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1783969553.068695:0:14798:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783969553.068721:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3284:x1870627280612352:12345-0@lo:8:kworker.0 Request processed in 34us (679us total) trans 0 rc -19/-19 00000100:00100000:0.0:1783969553.068728:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783969553.069892:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac785315880 x1870627280612224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783969573 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969553.069905:0:3284:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783969553.069915:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783969553.069925:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783969553.069945:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783969553.069948:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9ac791bb0000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783969553.069969:0:3284:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783969553.069976:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1870627280612224:0@lo:8:kworker.0 00000004:00080000:0.0:1783969553.070028:0:14184:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783969553.070213:0:14185:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1783969553.070246:0:14185:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14185:1870627280612864:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783969553.070313:0:14185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1783969553.070322:0:14184:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 410152460941ns, next at 0ns, rc = 0 00000100:00100000:3.0:1783969553.070342:0:14185:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac786283300 going to sleep for 11 seconds 00000100:00100000:0.0:1783969553.070377:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280612864 00000100:00100000:0.0:1783969553.070388:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280612864 00000100:00100000:0.0:1783969553.070444:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783969553.070455:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785316d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14185:x1870627280612864:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783969553.070979:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280612736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783969553.071024:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969553.071352:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280612736 00000100:00100000:3.0:1783969553.071358:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280612736 00000100:00100000:3.0:1783969553.071403:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783969553.071413:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1870627280612736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783969553.071441:0:14800:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783969553.071497:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3285:x1870627280612736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969553.071505:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783969553.071638:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac785314000 x1870627280612736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969569 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969553.071658:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280612736:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783969553.075522:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783969553.075580:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9ac7c04f7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783969553.075588:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783969553.075592:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1870627280612352:0@lo:8:kworker.0 00002000:00080000:0.0:1783969553.076602:0:14798:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1783969553.076612:0:14798:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1783969553.076618:0:14798:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:0.0:1783969553.102617:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969553.102630:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb167ace/0xbacf56d076fabee4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.102648:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783969553.102653:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969553.102659:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb167ace/0xbacf56d076fabee4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.102678:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb167ace/0xbacf56d076fabee4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.102688:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb167ace/0xbacf56d076fabee4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.102696:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb167ace/0xbacf56d076fabee4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.102728:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783969553.103393:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969553.103400:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2dec94e/0xbacf56d076fabeeb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.103417:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783969553.103420:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969553.103425:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2dec94e/0xbacf56d076fabeeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.103436:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2dec94e/0xbacf56d076fabeeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.103445:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2dec94e/0xbacf56d076fabeeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.103453:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2dec94e/0xbacf56d076fabeeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.103469:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783969553.103479:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783969553.103485:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb167ace/0xbacf56d076fabee4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.103493:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93600 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969553.103498:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb167ace/0xbacf56d076fabee4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.103506:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb167ace/0xbacf56d076fabee4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.103535:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb167ace/0xbacf56d076fabee4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.103543:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb167ace/0xbacf56d076fabee4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.103559:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969553.103563:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2dec94e/0xbacf56d076fabeeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.103569:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92c00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969553.103572:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2dec94e/0xbacf56d076fabeeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.103580:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2dec94e/0xbacf56d076fabeeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.103589:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2dec94e/0xbacf56d076fabeeb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.103597:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2dec94e/0xbacf56d076fabeeb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.103609:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969553.103610:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969553.103619:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969553.104057:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969553.104063:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fabef2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.104073:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783969553.104076:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969553.104080:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fabef2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.104090:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fabef2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.104098:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fabef2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.104105:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fabef2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.104121:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783969553.104130:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969553.104133:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fabef2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.104139:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93c00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969553.104142:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fabef2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.104159:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fabef2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.104168:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fabef2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.104175:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fabef2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.104186:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969553.104188:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969553.104189:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969553.104567:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969553.104573:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000340f7ec7/0xbacf56d076fabef9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.104581:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783969553.104585:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969553.104589:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000340f7ec7/0xbacf56d076fabef9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.104597:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000340f7ec7/0xbacf56d076fabef9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.104605:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000340f7ec7/0xbacf56d076fabef9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.104617:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000340f7ec7/0xbacf56d076fabef9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.104630:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783969553.104637:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969553.104640:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000340f7ec7/0xbacf56d076fabef9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.104646:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92400 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969553.104649:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000340f7ec7/0xbacf56d076fabef9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.104656:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000340f7ec7/0xbacf56d076fabef9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.104666:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000340f7ec7/0xbacf56d076fabef9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.104673:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000340f7ec7/0xbacf56d076fabef9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.104684:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969553.104685:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969553.104687:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969553.105107:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969553.105121:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabf00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.105130:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783969553.105133:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969553.105137:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabf00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.105145:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabf00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.105152:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabf00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.105158:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabf00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.105172:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783969553.105182:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969553.105185:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabf00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.105190:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93000 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969553.105193:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabf00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.105200:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabf00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.106716:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969553.115299:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabf00 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.115319:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabf00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.115349:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969553.115352:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969553.115354:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969553.116004:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969553.116013:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fabf07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.116027:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783969553.116032:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969553.116039:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fabf07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.116051:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fabf07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.116060:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fabf07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.116068:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fabf07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.116105:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783969553.116118:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969553.116124:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fabf07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.116132:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92e00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969553.116136:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fabf07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.116145:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fabf07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.116160:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fabf07 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.116167:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9f66048/0xbacf56d076fabf07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.116182:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969553.116183:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969553.116185:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969553.116591:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969553.116597:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa6c4149/0xbacf56d076fabf0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.116607:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783969553.116615:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969553.116620:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa6c4149/0xbacf56d076fabf0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.116629:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa6c4149/0xbacf56d076fabf0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.116637:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa6c4149/0xbacf56d076fabf0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.116644:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa6c4149/0xbacf56d076fabf0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.116660:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783969553.116685:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969553.116690:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa6c4149/0xbacf56d076fabf0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.116697:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92000 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969553.116700:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa6c4149/0xbacf56d076fabf0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.116708:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa6c4149/0xbacf56d076fabf0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.116719:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa6c4149/0xbacf56d076fabf0e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.116738:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa6c4149/0xbacf56d076fabf0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.116752:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969553.116753:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969553.116755:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969553.117185:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969553.117191:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007eab34c7/0xbacf56d076fabf15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.117200:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783969553.117203:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969553.117207:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007eab34c7/0xbacf56d076fabf15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.117229:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007eab34c7/0xbacf56d076fabf15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.117237:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007eab34c7/0xbacf56d076fabf15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.117244:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007eab34c7/0xbacf56d076fabf15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.117259:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783969553.117266:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969553.117276:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007eab34c7/0xbacf56d076fabf15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.117283:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93e00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969553.117287:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007eab34c7/0xbacf56d076fabf15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.117294:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007eab34c7/0xbacf56d076fabf15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.117305:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007eab34c7/0xbacf56d076fabf15 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.117312:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007eab34c7/0xbacf56d076fabf15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.117326:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969553.117327:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969553.117329:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969553.137478:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969553.137493:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabf1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.137510:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783969553.137515:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969553.137521:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabf1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.137550:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabf1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.137561:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabf1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.137569:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabf1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.137601:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783969553.137841:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969553.137850:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabf1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.137878:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93000 already unused, calling callback (ffffffffc1485230) 00010000:00010000:2.0:1783969553.137883:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabf1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.137893:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabf1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.137914:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabf1c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.137921:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4b79086/0xbacf56d076fabf1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.137970:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969553.137972:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969553.137975:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969553.138196:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969553.138203:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000340f7ec7/0xbacf56d076fabf23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.138213:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783969553.138228:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969553.138232:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000340f7ec7/0xbacf56d076fabf23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.138243:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000340f7ec7/0xbacf56d076fabf23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.138250:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000340f7ec7/0xbacf56d076fabf23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.138268:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000340f7ec7/0xbacf56d076fabf23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.138291:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783969553.138328:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969553.138335:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000340f7ec7/0xbacf56d076fabf23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.138344:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92400 already unused, calling callback (ffffffffc1485230) 00010000:00010000:2.0:1783969553.138348:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000340f7ec7/0xbacf56d076fabf23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.138356:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000340f7ec7/0xbacf56d076fabf23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.138367:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000340f7ec7/0xbacf56d076fabf23 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.138374:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000340f7ec7/0xbacf56d076fabf23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.138391:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969553.138394:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969553.138396:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969553.138692:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969553.138698:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fabf2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.138706:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783969553.138709:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969553.138713:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fabf2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.138723:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fabf2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.138731:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fabf2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.138738:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fabf2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.138761:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783969553.138899:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969553.138904:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fabf2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.138923:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93c00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:2.0:1783969553.138928:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fabf2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.138936:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fabf2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.138950:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fabf2a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.138967:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd694e52/0xbacf56d076fabf2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.138984:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969553.138987:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969553.138990:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969553.142464:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969553.142480:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2dec94e/0xbacf56d076fabf31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.142505:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783969553.142510:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969553.142517:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2dec94e/0xbacf56d076fabf31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.142532:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2dec94e/0xbacf56d076fabf31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.142542:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2dec94e/0xbacf56d076fabf31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.142549:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2dec94e/0xbacf56d076fabf31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.142583:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783969553.142678:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969553.142686:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2dec94e/0xbacf56d076fabf31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.142696:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92c00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:2.0:1783969553.142701:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2dec94e/0xbacf56d076fabf31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.142711:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2dec94e/0xbacf56d076fabf31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.142737:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2dec94e/0xbacf56d076fabf31 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.142744:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2dec94e/0xbacf56d076fabf31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.142769:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969553.142771:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969553.142774:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969553.144152:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969553.144164:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb167ace/0xbacf56d076fabf38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.144178:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783969553.144183:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969553.144189:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb167ace/0xbacf56d076fabf38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.144201:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb167ace/0xbacf56d076fabf38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.144233:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb167ace/0xbacf56d076fabf38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.144241:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb167ace/0xbacf56d076fabf38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.144266:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1783969553.144462:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1783969553.144531:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969553.144539:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb167ace/0xbacf56d076fabf38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.144547:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93600 already unused, calling callback (ffffffffc1485230) 00010000:00010000:2.0:1783969553.144552:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb167ace/0xbacf56d076fabf38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.144560:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb167ace/0xbacf56d076fabf38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.144577:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb167ace/0xbacf56d076fabf38 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.144699:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb167ace/0xbacf56d076fabf38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.144734:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969553.144737:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969553.144739:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969553.144844:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969553.144850:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c261994/0xbacf56d076fabf3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.144880:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783969553.144884:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969553.144889:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c261994/0xbacf56d076fabf3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.144899:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c261994/0xbacf56d076fabf3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.144907:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c261994/0xbacf56d076fabf3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.144915:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c261994/0xbacf56d076fabf3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.144942:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783969553.145354:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969553.145360:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070791dd9/0xbacf56d076fabf46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.145369:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783969553.145372:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969553.145376:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070791dd9/0xbacf56d076fabf46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.145385:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070791dd9/0xbacf56d076fabf46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.145394:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070791dd9/0xbacf56d076fabf46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.145401:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070791dd9/0xbacf56d076fabf46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.145425:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783969553.145635:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783969553.145641:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c261994/0xbacf56d076fabf3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.145650:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac780030a00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:2.0:1783969553.145653:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c261994/0xbacf56d076fabf3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.145661:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c261994/0xbacf56d076fabf3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.145675:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c261994/0xbacf56d076fabf3f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.145682:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c261994/0xbacf56d076fabf3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.145699:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969553.145703:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070791dd9/0xbacf56d076fabf46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.145709:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac780030400 already unused, calling callback (ffffffffc1485230) 00010000:00010000:2.0:1783969553.145721:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070791dd9/0xbacf56d076fabf46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.145728:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070791dd9/0xbacf56d076fabf46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.145740:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070791dd9/0xbacf56d076fabf46 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.145747:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070791dd9/0xbacf56d076fabf46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.145763:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969553.145765:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969553.145767:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969553.145838:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969553.145844:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fed2b4b2/0xbacf56d076fabf4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.145852:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783969553.145880:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969553.145886:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fed2b4b2/0xbacf56d076fabf4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.145895:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fed2b4b2/0xbacf56d076fabf4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.145903:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fed2b4b2/0xbacf56d076fabf4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.145910:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fed2b4b2/0xbacf56d076fabf4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.145925:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783969553.146048:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969553.146054:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fed2b4b2/0xbacf56d076fabf4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969553.146061:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac780030c00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:3.0:1783969553.146064:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fed2b4b2/0xbacf56d076fabf4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969553.146073:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fed2b4b2/0xbacf56d076fabf4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969553.146096:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fed2b4b2/0xbacf56d076fabf4d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969553.146103:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fed2b4b2/0xbacf56d076fabf4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969553.146125:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969553.146127:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969553.146130:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969553.147471:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969553.165279:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969553.165293:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d49339f9/0xbacf56d076fabf54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.165310:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783969553.165314:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969553.165320:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d49339f9/0xbacf56d076fabf54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.165333:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d49339f9/0xbacf56d076fabf54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.165342:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d49339f9/0xbacf56d076fabf54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.165359:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d49339f9/0xbacf56d076fabf54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.165387:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783969553.165949:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969553.165955:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb10c19c/0xbacf56d076fabf5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.165966:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783969553.165969:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969553.165973:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb10c19c/0xbacf56d076fabf5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.165983:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb10c19c/0xbacf56d076fabf5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.165991:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb10c19c/0xbacf56d076fabf5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.165999:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb10c19c/0xbacf56d076fabf5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.166668:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783969553.166683:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783969553.166692:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d49339f9/0xbacf56d076fabf54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969553.166705:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac780031800 already unused, calling callback (ffffffffc1485230) 00010000:00010000:3.0:1783969553.166710:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d49339f9/0xbacf56d076fabf54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969553.166721:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d49339f9/0xbacf56d076fabf54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969553.166740:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d49339f9/0xbacf56d076fabf54 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969553.166749:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d49339f9/0xbacf56d076fabf54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969553.166789:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969553.166794:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb10c19c/0xbacf56d076fabf5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969553.166801:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac780031600 already unused, calling callback (ffffffffc1485230) 00010000:00010000:3.0:1783969553.166805:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb10c19c/0xbacf56d076fabf5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969553.166813:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb10c19c/0xbacf56d076fabf5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969553.166824:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb10c19c/0xbacf56d076fabf5b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969553.166832:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb10c19c/0xbacf56d076fabf5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969553.166848:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969553.166851:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969553.166853:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969553.168375:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969553.168584:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d90fe3e3/0xbacf56d076fabf62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.168609:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783969553.168613:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969553.168620:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d90fe3e3/0xbacf56d076fabf62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.168633:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d90fe3e3/0xbacf56d076fabf62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.168643:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d90fe3e3/0xbacf56d076fabf62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.168650:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d90fe3e3/0xbacf56d076fabf62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.168676:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783969553.168914:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969553.168922:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d90fe3e3/0xbacf56d076fabf62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969553.168932:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac780031400 already unused, calling callback (ffffffffc1485230) 00010000:00010000:3.0:1783969553.168945:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d90fe3e3/0xbacf56d076fabf62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969553.168964:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d90fe3e3/0xbacf56d076fabf62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969553.168983:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d90fe3e3/0xbacf56d076fabf62 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969553.168990:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d90fe3e3/0xbacf56d076fabf62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969553.169014:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969553.169015:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969553.169017:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969553.169153:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969553.169350:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969553.169357:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6a55749/0xbacf56d076fabf69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.169368:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783969553.169371:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969553.169376:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6a55749/0xbacf56d076fabf69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.169386:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6a55749/0xbacf56d076fabf69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.169407:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6a55749/0xbacf56d076fabf69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.169553:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6a55749/0xbacf56d076fabf69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.169571:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783969553.170724:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969553.170736:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e342160/0xbacf56d076fabf70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.170749:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783969553.170752:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969553.170757:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e342160/0xbacf56d076fabf70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.170769:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e342160/0xbacf56d076fabf70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.170778:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e342160/0xbacf56d076fabf70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.170786:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e342160/0xbacf56d076fabf70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.170825:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783969553.170924:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783969553.170931:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6a55749/0xbacf56d076fabf69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.170939:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac780030600 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969553.170944:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6a55749/0xbacf56d076fabf69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.170953:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6a55749/0xbacf56d076fabf69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.170973:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6a55749/0xbacf56d076fabf69 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.170982:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6a55749/0xbacf56d076fabf69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.171094:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969553.171099:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e342160/0xbacf56d076fabf70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.171106:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac780031200 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969553.171110:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e342160/0xbacf56d076fabf70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.171118:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e342160/0xbacf56d076fabf70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.171128:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e342160/0xbacf56d076fabf70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.171136:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e342160/0xbacf56d076fabf70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.171149:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969553.171151:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969553.171153:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969553.171721:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969553.171728:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3f73aba/0xbacf56d076fabf77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.171739:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783969553.171743:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969553.171748:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3f73aba/0xbacf56d076fabf77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.171759:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3f73aba/0xbacf56d076fabf77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.171766:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3f73aba/0xbacf56d076fabf77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.171773:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3f73aba/0xbacf56d076fabf77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.171798:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969553.173130:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969553.173142:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3f73aba/0xbacf56d076fabf77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.173153:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac780031000 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969553.173167:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3f73aba/0xbacf56d076fabf77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.173177:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3f73aba/0xbacf56d076fabf77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.173195:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3f73aba/0xbacf56d076fabf77 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.173203:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3f73aba/0xbacf56d076fabf77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.173234:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969553.173236:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969553.173237:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969553.173587:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969553.173595:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fed2b4b2/0xbacf56d076fabf7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.173606:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783969553.173616:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969553.173622:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fed2b4b2/0xbacf56d076fabf7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.173633:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fed2b4b2/0xbacf56d076fabf7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.173641:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fed2b4b2/0xbacf56d076fabf7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.173648:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fed2b4b2/0xbacf56d076fabf7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.173702:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783969553.174178:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969553.174185:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007eab34c7/0xbacf56d076fabf85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.174197:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783969553.174201:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969553.174206:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007eab34c7/0xbacf56d076fabf85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.174227:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007eab34c7/0xbacf56d076fabf85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.174236:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007eab34c7/0xbacf56d076fabf85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.174250:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007eab34c7/0xbacf56d076fabf85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.179392:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783969553.179407:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fed2b4b2/0xbacf56d076fabf7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.179420:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac780030c00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969553.179424:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fed2b4b2/0xbacf56d076fabf7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.179435:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fed2b4b2/0xbacf56d076fabf7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.179454:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fed2b4b2/0xbacf56d076fabf7e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.179476:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fed2b4b2/0xbacf56d076fabf7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.179504:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969553.179508:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007eab34c7/0xbacf56d076fabf85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.179514:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93e00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969553.179517:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007eab34c7/0xbacf56d076fabf85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.179525:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007eab34c7/0xbacf56d076fabf85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.179534:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007eab34c7/0xbacf56d076fabf85 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.179541:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969553.179542:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969553.179544:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969553.179767:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783969553.179775:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007eab34c7/0xbacf56d076fabf85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.180102:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969553.183412:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969553.183427:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa6c4149/0xbacf56d076fabf8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.183446:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783969553.183451:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969553.183459:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa6c4149/0xbacf56d076fabf8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.183473:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa6c4149/0xbacf56d076fabf8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.183483:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa6c4149/0xbacf56d076fabf8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.183490:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa6c4149/0xbacf56d076fabf8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.184141:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969553.184631:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969553.184639:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa6c4149/0xbacf56d076fabf8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.184650:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92000 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969553.184662:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa6c4149/0xbacf56d076fabf8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.184671:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa6c4149/0xbacf56d076fabf8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.184689:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa6c4149/0xbacf56d076fabf8c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.184697:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa6c4149/0xbacf56d076fabf8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.184776:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969553.188281:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969553.188287:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969553.188289:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783969553.193754:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783969553.193768:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0f3cda3/0xbacf56d076fabf93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.193784:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=410s v=(0 0) 00010000:00010000:1.0:1783969553.193788:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969553.193794:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0f3cda3/0xbacf56d076fabf93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.193807:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0f3cda3/0xbacf56d076fabf93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.193818:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0f3cda3/0xbacf56d076fabf93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.193835:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0f3cda3/0xbacf56d076fabf93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.193971:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783969553.196668:0:14798:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783969553.196679:0:14798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1697cf9/0xbacf56d076fabf9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.196696:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=410s v=(0 0) 00010000:00010000:1.0:1783969553.196701:0:14798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969553.196707:0:14798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1697cf9/0xbacf56d076fabf9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.196720:0:14798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1697cf9/0xbacf56d076fabf9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.196729:0:14798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1697cf9/0xbacf56d076fabf9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.196737:0:14798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1697cf9/0xbacf56d076fabf9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.198105:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783969553.198120:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0f3cda3/0xbacf56d076fabf93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.198133:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60f000 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969553.198137:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0f3cda3/0xbacf56d076fabf93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.198146:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0f3cda3/0xbacf56d076fabf93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.198164:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0f3cda3/0xbacf56d076fabf93 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.198172:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0f3cda3/0xbacf56d076fabf93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.198194:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969553.198197:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1697cf9/0xbacf56d076fabf9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.198203:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60ec00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969553.198207:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1697cf9/0xbacf56d076fabf9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.198246:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1697cf9/0xbacf56d076fabf9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.198258:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1697cf9/0xbacf56d076fabf9a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.198266:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969553.198268:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969553.198270:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969553.198625:0:14798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783969553.198633:0:14798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1697cf9/0xbacf56d076fabf9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1783969553.199224:0:14798:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1783969553.199329:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785316d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14185:x1870627280612864:12345-0@lo:5:osp-pre-0-0.0 Request processed in 128873us (129012us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969553.199343:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783969553.199652:0:14185:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14185:1870627280612864:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1783969553.199667:0:14185:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:0.0:1783969553.199710:0:14185:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14185:1870627280612992:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783969553.199747:0:14185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969553.199794:0:14185:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7c1579cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1783969553.200062:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969553.200114:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280612992 00000100:00100000:1.0:1783969553.200120:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280612992 00000100:00100000:1.0:1783969553.200165:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783969553.200174:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14185:x1870627280612992:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1783969553.200212:0:14799:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:3.0:1783969553.202086:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969553.227802:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14185:x1870627280612992:12345-0@lo:5:osp-pre-0-0.0 Request processed in 27619us (28045us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1783969553.228019:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783969553.229100:0:14185:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14185:1870627280612992:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783969553.229120:0:14185:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000020:01000004:0.0:1783969553.771784:0:15465:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1783969553.771789:0:15465:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1783969553.771938:0:15465:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9ac79e0fc000 00000020:01000004:0.0:1783969553.771954:0:15465:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1783969553.771967:0:15465:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1783969553.771981:0:15465:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ac7917f19c0) 00000020:00000080:0.0:1783969553.771997:0:15465:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1783969553.823071:0:15465:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1783969553.823383:0:15465:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1783969553.824389:0:15465:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783969553.825784:0:15465:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1783969553.826655:0:15465:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1783969553.827067:0:15465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 159: rc = 0 00100000:10000000:2.0:1783969553.827160:0:15465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 159: rc = 0 00100000:10000000:2.0:1783969553.827268:0:15465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 159: rc = 0 00100000:10000000:2.0:1783969553.827826:0:15465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 503: rc = 0 00100000:10000000:2.0:1783969553.828254:0:15465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 503: rc = 0 00100000:10000000:2.0:1783969553.828683:0:15465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 503: rc = 0 00100000:10000000:2.0:1783969553.828992:0:15465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 503: rc = 0 00100000:10000000:2.0:1783969553.829636:0:15465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 503: rc = 0 00100000:10000000:2.0:1783969553.830070:0:15465:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 503: rc = 0 00000020:00000080:2.0:1783969553.830788:0:15465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1783969553.830800:0:15465:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783969553.830811:0:15465:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbacf56d076fabfa8 00000020:01000004:2.0:1783969553.830819:0:15465:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1783969553.830838:0:15465:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.139@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783969553.830841:0:15465:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783969553.830847:0:15465:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1783969553.830900:0:15465:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1783969553.830905:0:15465:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.139@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1783969553.858286:0:15465:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.139@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783969553.858328:0:15465:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.139@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1783969553.858333:0:15465:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783969553.858335:0:15465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783969553.858336:0:15465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783969553.858338:0:15465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783969553.858339:0:15465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783969553.858341:0:15465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783969553.858342:0:15465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783969553.858343:0:15465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783969553.858349:0:15465:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783969553.858353:0:15465:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1783969553.858355:0:15465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783969553.858356:0:15465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783969553.858357:0:15465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783969553.858357:0:15465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783969553.858358:0:15465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783969553.858359:0:15465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783969553.858360:0:15465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783969553.858361:0:15465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783969553.858361:0:15465:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783969553.858385:0:15465:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783969553.858404:0:15465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785317100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280613120:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783969553.858464:0:15465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969553.858986:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280613120 00000100:00100000:1.0:1783969553.858994:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280613120 00000100:00100000:1.0:1783969553.859051:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783969553.859059:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:15465:x1870627280613120:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783969553.859100:0:14157:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1783969553.859103:0:14157:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1783969553.859107:0:14157:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1783969553.859330:0:15465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b2fafc00 going to sleep for 11 seconds 00000100:00100000:1.0:1783969553.870993:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:15465:x1870627280613120:12345-0@lo:253:mount.lustre.0 Request processed in 11925us (12518us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969553.871007:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783969553.872956:0:15465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785317100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280613120:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783969553.872976:0:15465:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783969553.872979:0:15465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783969553.872981:0:15465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783969553.872983:0:15465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783969553.872985:0:15465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783969553.872986:0:15465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783969553.872987:0:15465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783969553.872989:0:15465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783969553.872991:0:15465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783969553.872992:0:15465:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783969553.873016:0:15465:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ac79e0fc000 from lustre-OST0001 10000000:01000000:3.0:1783969553.873042:0:15465:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1783969553.873045:0:15465:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783969553.873053:0:15465:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ac7ba650000 local copy 00010000:00010000:3.0:1783969553.873064:0:15465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de7a00/0xbacf56d076fabd55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabd5c expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969553.873332:0:15465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785317100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280613248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969553.873397:0:15465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969553.873441:0:15465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b2faf540 going to sleep for 11 seconds 00000100:00100000:2.0:1783969553.873623:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280613248 00000100:00100000:2.0:1783969553.873629:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280613248 00000100:00100000:2.0:1783969553.873668:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783969553.873678:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:15465:x1870627280613248:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783969553.873835:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:15465:x1870627280613248:12345-0@lo:501:mount.lustre.0 Request processed in 158us (437us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783969553.873843:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783969553.874087:0:15465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785317100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280613248:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783969553.874100:0:15465:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783969553.874267:0:15465:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783969553.874275:0:15465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de7a00/0xbacf56d076fabd55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabd5c expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969553.874284:0:15465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac783de7a00/0xbacf56d076fabd55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabd5c expref: -99 pid: 14145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969553.874308:0:15465:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ac79e0fc000 10000000:01000000:3.0:1783969553.874313:0:15465:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783969553.874317:0:15465:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783969553.874320:0:15465:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783969553.874323:0:15465:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1783969553.874326:0:15465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783969553.874348:0:15465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de7000/0xbacf56d076fabfaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969553.874356:0:15465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac783de7000/0xbacf56d076fabfaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969553.874365:0:15465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac783de7000/0xbacf56d076fabfaf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969553.874379:0:15465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785317100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280613376:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783969553.874409:0:15465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969553.874446:0:15465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b2faf540 going to sleep for 11 seconds 00000100:00100000:1.0:1783969553.874507:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280613376 00000100:00100000:1.0:1783969553.874512:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280613376 00000100:00100000:1.0:1783969553.874553:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783969553.874561:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:15465:x1870627280613376:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783969553.874570:0:14157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969553.874583:0:14157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7bf60fc00/0xbacf56d076fabfb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076fabfaf expref: -99 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.874604:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7bf60fc00/0xbacf56d076fabfb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076fabfaf expref: 17 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.874613:0:14157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7bf60fc00/0xbacf56d076fabfb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fabfaf expref: 17 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.874620:0:14157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bf60fc00, rc 0) 00000100:00100000:1.0:1783969553.874660:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+17:15465:x1870627280613376:12345-0@lo:101:mount.lustre.0 Request processed in 100us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969553.874665:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783969553.874833:0:15465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785317100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280613376:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783969553.874846:0:15465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac783de7000/0xbacf56d076fabfaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabfb6 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969553.874855:0:15465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac783de7000/0xbacf56d076fabfaf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076fabfb6 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783969553.875505:0:15465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1783969553.877776:0:15465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783969553.878926:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1783969553.878988:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1783969553.879025:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1783969553.879088:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1783969553.879130:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1783969553.879167:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1783969553.879256:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1783969553.879265:0:15465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1783969553.879360:0:15465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785317100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280613504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969553.879427:0:15465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969553.879475:0:15465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b2faf540 going to sleep for 11 seconds 00000100:00100000:0.0:1783969553.880656:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280613504 00000100:00100000:0.0:1783969553.880668:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280613504 00000100:00100000:0.0:1783969553.880726:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783969553.880735:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+17:15465:x1870627280613504:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783969553.881171:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+17:15465:x1870627280613504:12345-0@lo:501:mount.lustre.0 Request processed in 436us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969553.881187:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783969553.881319:0:15465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785317100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280613504:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783969553.881369:0:15465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1be8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280613632:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783969553.881416:0:15465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969553.881459:0:15465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfda69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783969553.881534:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280613632 00000100:00100000:1.0:1783969553.881539:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280613632 00000100:00100000:1.0:1783969553.881576:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783969553.881582:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+17:15465:x1870627280613632:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783969553.881856:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+17:15465:x1870627280613632:12345-0@lo:503:mount.lustre.0 Request processed in 273us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969553.881884:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783969553.882042:0:15465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1be8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280613632:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783969553.882945:0:15465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783969553.883011:0:15465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1be8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280613760:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783969553.883066:0:15465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969553.883097:0:15465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfda69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969553.883235:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280613760 00000100:00100000:0.0:1783969553.883242:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280613760 00000100:00100000:0.0:1783969553.883282:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783969553.883290:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+17:15465:x1870627280613760:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783969553.883478:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+17:15465:x1870627280613760:12345-0@lo:502:mount.lustre.0 Request processed in 188us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969553.883485:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783969553.884001:0:15465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1be8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280613760:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783969553.884246:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1783969553.884300:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1783969553.884336:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1783969553.884387:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1783969553.884426:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1783969553.884462:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1783969553.885961:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1783969553.886066:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1783969553.886168:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1783969553.886230:0:15465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1be8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280613888:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783969553.886303:0:15465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969553.886337:0:15465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bfda69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969553.886422:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280613888 00000100:00100000:0.0:1783969553.886428:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280613888 00000100:00100000:0.0:1783969553.886476:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783969553.886486:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+17:15465:x1870627280613888:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783969553.886803:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+17:15465:x1870627280613888:12345-0@lo:502:mount.lustre.0 Request processed in 318us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969553.886811:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783969553.887202:0:15465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1be8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280613888:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783969553.887303:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1783969553.887315:0:15465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1783969553.891163:0:15467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783969553.891175:0:15467:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1783969553.891181:0:15467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783969553.891183:0:15467:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1783969553.891189:0:15467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783969553.891205:0:15467:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ac7c1fbb380) 00000020:00000080:3.0:1783969553.891238:0:15467:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1783969553.891245:0:15467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783969553.891329:0:15467:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac79e0fc000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1783969553.891339:0:15467:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783969553.891352:0:15467:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbacf56d076fabfc4 00010000:00010000:2.0:1783969553.897752:0:15467:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1783969553.898149:0:15467:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1783969553.903060:0:15467:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1783969553.906163:0:15467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1783969553.906174:0:15467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969553.906181:0:15467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969553.906183:0:15467:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1783969553.906188:0:15467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969553.906191:0:15467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969553.906193:0:15467:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783969553.906196:0:15467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783969553.906198:0:15467:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783969553.906200:0:15467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969553.906202:0:15467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969553.906203:0:15467:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783969553.906206:0:15467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969553.906226:0:15467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969553.906228:0:15467:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783969553.906233:0:15467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1783969553.906299:0:15467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969553.906303:0:15467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969553.906304:0:15467:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783969553.906308:0:15467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1783969553.906541:0:15465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1783969553.906565:0:15465:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783969553.906578:0:15465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de7000/0xbacf56d076fabfaf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabfb6 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.906590:0:15465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac783de7000/0xbacf56d076fabfaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabfb6 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969553.906598:0:15465:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ac79e0fc000 from 1 10000000:01000000:2.0:1783969553.906607:0:15465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783969553.906641:0:15465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac786098600/0xbacf56d076fabfcb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.906649:0:15465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac786098600/0xbacf56d076fabfcb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.906658:0:15465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac786098600/0xbacf56d076fabfcb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969553.906681:0:15465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1be8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280614016:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783969553.906740:0:15465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969553.906784:0:15465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac78133ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1783969553.911066:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280614016 00000100:00100000:0.0:1783969553.911082:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280614016 00000100:00100000:0.0:1783969553.911141:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783969553.911151:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+17:15465:x1870627280614016:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783969553.911169:0:14158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969553.911188:0:14158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7bfb93e00/0xbacf56d076fabfd2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076fabfcb expref: -99 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.911226:0:14158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7bfb93e00/0xbacf56d076fabfd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076fabfcb expref: 18 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.911239:0:14158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7bfb93e00/0xbacf56d076fabfd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fabfcb expref: 18 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.911248:0:14158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb93e00, rc 0) 00000100:00100000:0.0:1783969553.911316:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+18:15465:x1870627280614016:12345-0@lo:101:mount.lustre.0 Request processed in 166us (4575us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969553.911323:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783969553.911662:0:15465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1be8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280614016:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783969553.911681:0:15465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac786098600/0xbacf56d076fabfcb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabfd2 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969553.911691:0:15465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac786098600/0xbacf56d076fabfcb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076fabfd2 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783969553.912228:0:15465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1783969553.912513:0:15465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783969553.912792:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1783969553.912840:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1783969553.912940:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1783969553.912949:0:15465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1783969553.913023:0:15465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1be8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280614144:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783969553.913075:0:15465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969553.913113:0:15465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac78133ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1783969553.913475:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280614144 00000100:00100000:0.0:1783969553.913482:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280614144 00000100:00100000:0.0:1783969553.913535:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783969553.913545:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+18:15465:x1870627280614144:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783969553.913751:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+18:15465:x1870627280614144:12345-0@lo:501:mount.lustre.0 Request processed in 206us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969553.913766:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783969553.913977:0:15465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1be8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280614144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969553.914019:0:15465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785317100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280614272:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783969553.914063:0:15465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969553.914082:0:15465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac786283300 going to sleep for 11 seconds 00000100:00100000:1.0:1783969553.914151:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280614272 00000100:00100000:1.0:1783969553.914156:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280614272 00000100:00100000:1.0:1783969553.914180:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783969553.914187:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+18:15465:x1870627280614272:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783969553.914421:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bfc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+18:15465:x1870627280614272:12345-0@lo:503:mount.lustre.0 Request processed in 233us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969553.914428:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783969553.915060:0:15465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785317100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280614272:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783969553.916472:0:15465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783969553.918792:0:15465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785317100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280614400:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783969553.919005:0:15465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969553.919047:0:15465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac786283300 going to sleep for 11 seconds 00000100:00100000:0.0:1783969553.919633:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280614400 00000100:00100000:0.0:1783969553.919640:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280614400 00000100:00100000:0.0:1783969553.919690:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783969553.919699:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+18:15465:x1870627280614400:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783969553.920078:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+18:15465:x1870627280614400:12345-0@lo:502:mount.lustre.0 Request processed in 379us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969553.920088:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783969553.920176:0:15465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785317100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280614400:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783969553.920454:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1783969553.920677:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1783969553.920739:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1783969553.920797:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1783969553.920837:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1783969553.921347:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1783969553.921391:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1783969553.921426:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1783969553.921469:0:15465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1be8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280614528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783969553.922477:0:15465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969553.922624:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280614528 00000100:00100000:1.0:1783969553.922633:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280614528 00000100:00100000:1.0:1783969553.922683:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783969553.922692:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+18:15465:x1870627280614528:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783969553.922933:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+18:15465:x1870627280614528:12345-0@lo:502:mount.lustre.0 Request processed in 241us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969553.922940:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783969553.923060:0:15465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac78133a240 going to sleep for 11 seconds 00000100:00100000:0.0:1783969553.923083:0:15465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1be8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280614528:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783969553.923202:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1783969553.923227:0:15465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1783969553.924996:0:15471:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969553.925006:0:15471:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969553.925009:0:15471:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783969553.925015:0:15471:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac79e0fc000 00000020:00000080:0.0:1783969553.925018:0:15471:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783969553.925024:0:15471:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969553.925026:0:15471:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969553.925028:0:15471:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783969553.925030:0:15471:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969553.925032:0:15471:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969553.925033:0:15471:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783969553.925036:0:15471:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ac79e0fc000 00000020:00000080:0.0:1783969553.925039:0:15471:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783969553.925091:0:15471:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969553.925095:0:15471:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969553.925096:0:15471:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783969553.925099:0:15471:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783969553.925108:0:15471:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969553.925109:0:15471:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783969553.925121:0:15471:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ac79e0fc000 00000020:00000080:0.0:1783969553.925123:0:15471:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783969553.925162:0:15471:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783969553.925165:0:15471:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783969553.925166:0:15471:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783969553.925169:0:15471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1783969553.940724:0:15465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1783969553.940760:0:15465:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783969553.940779:0:15465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac786098600/0xbacf56d076fabfcb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabfd2 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.940792:0:15465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac786098600/0xbacf56d076fabfcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabfd2 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969553.940844:0:15465:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783969553.940847:0:15465:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ac79e0fc000 10000000:01000000:1.0:1783969553.940851:0:15465:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ac79e0fc000 10000000:01000000:1.0:1783969553.940855:0:15465:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783969553.942779:0:15465:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9ac79e0fc000 from 1 10000000:01000000:1.0:1783969553.942785:0:15465:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783969553.942832:0:15465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e800/0xbacf56d076fabfd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.942847:0:15465:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e800/0xbacf56d076fabfd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.945409:0:15465:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e800/0xbacf56d076fabfd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969553.945437:0:15465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280614656:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783969553.945506:0:15465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969553.945557:0:15465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b2f3bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969553.947254:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280614656 00000100:00100000:0.0:1783969553.947267:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280614656 00000100:00100000:0.0:1783969553.947326:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783969553.947339:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+18:15465:x1870627280614656:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783969553.947357:0:14158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969553.947376:0:14158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac7bfb92e00/0xbacf56d076fabfe0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076fabfd9 expref: -99 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.947404:0:14158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac7bfb92e00/0xbacf56d076fabfe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076fabfd9 expref: 19 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.947417:0:14158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac7bfb92e00/0xbacf56d076fabfe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fabfd9 expref: 19 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969553.947425:0:14158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac7bfb92e00, rc 0) 00000100:00100000:0.0:1783969553.947503:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:15465:x1870627280614656:12345-0@lo:101:mount.lustre.0 Request processed in 167us (1997us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969553.947511:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783969553.951022:0:15465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280614656:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783969553.951052:0:15465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e800/0xbacf56d076fabfd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabfe0 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969553.951063:0:15465:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e800/0xbacf56d076fabfd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076fabfe0 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783969553.951678:0:15465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1783969553.952199:0:15465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783969553.952497:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1783969553.952546:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1783969553.952581:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1783969553.952630:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1783969553.952669:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1783969553.952716:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1783969553.952753:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1783969553.952787:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1783969553.952836:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1783969553.952927:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1783969553.952964:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1783969553.953013:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1783969553.953051:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1783969553.953089:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1783969553.953138:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1783969553.953174:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1783969553.953219:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1783969553.953270:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1783969553.953306:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1783969553.953337:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1783969553.953381:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1783969553.953418:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1783969553.953455:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1783969553.953503:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1783969553.953540:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1783969553.953596:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1783969553.953648:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1783969553.953683:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1783969553.953714:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1783969553.953761:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1783969553.953800:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1783969553.953834:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1783969553.953905:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1783969553.953972:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1783969553.954012:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1783969553.954057:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1783969553.954092:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1783969553.954174:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1783969553.954182:0:15465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1783969553.963191:0:15465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280614784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783969553.963470:0:15465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969553.963528:0:15465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac78c7d5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969553.967441:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280614784 00000100:00100000:0.0:1783969553.967456:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280614784 00000100:00100000:0.0:1783969553.967508:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783969553.967518:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:15465:x1870627280614784:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783969553.969133:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:15465:x1870627280614784:12345-0@lo:501:mount.lustre.0 Request processed in 1609us (5656us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969553.969146:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783969553.969477:0:15465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280614784:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783969553.969530:0:15465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280614912:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783969553.969584:0:15465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969553.969620:0:15465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b2f3b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969553.969677:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280614912 00000100:00100000:0.0:1783969553.969683:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280614912 00000100:00100000:0.0:1783969553.969725:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783969553.969732:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac793b0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:15465:x1870627280614912:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783969553.970547:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac793b0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:15465:x1870627280614912:12345-0@lo:503:mount.lustre.0 Request processed in 812us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969553.970555:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783969553.974390:0:15465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280614912:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783969553.975243:0:15465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783969553.975322:0:15465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1beb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280615040:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783969553.975402:0:15465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969553.975491:0:15465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b2faf480 going to sleep for 11 seconds 00000100:00100000:0.0:1783969553.979202:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280615040 00000100:00100000:0.0:1783969553.979227:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280615040 00000100:00100000:0.0:1783969553.979299:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783969553.979311:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac793b0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:15465:x1870627280615040:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783969553.979694:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac793b0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:15465:x1870627280615040:12345-0@lo:502:mount.lustre.0 Request processed in 385us (4291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969553.979703:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783969553.981576:0:15465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1beb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280615040:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783969553.982304:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1783969553.982371:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1783969553.982407:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1783969553.982457:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1783969553.982495:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1783969553.982558:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1783969553.982596:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1783969553.982625:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1783969553.982669:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1783969553.982696:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1783969553.982722:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1783969553.982757:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1783969553.982793:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1783969553.982828:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1783969553.983132:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1783969553.983170:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1783969553.983195:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1783969553.983249:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1783969553.983290:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1783969553.983328:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1783969553.983376:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1783969553.983426:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1783969553.983478:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1783969553.983527:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1783969553.983565:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1783969553.983599:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1783969553.983636:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1783969553.983661:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1783969553.983685:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1783969553.983720:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1783969553.983758:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1783969553.983792:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1783969553.983827:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1783969553.984129:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1783969553.984171:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1783969553.984232:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1783969553.984271:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1783969553.984321:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1783969553.984384:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1783969553.984424:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1783969553.984469:0:15465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280615168:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783969553.984544:0:15465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969553.984628:0:15465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac78c7d56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969553.984673:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280615168 00000100:00100000:0.0:1783969553.984680:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280615168 00000100:00100000:0.0:1783969553.984764:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783969553.984774:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac793b0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:15465:x1870627280615168:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783969553.985020:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac793b0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:15465:x1870627280615168:12345-0@lo:502:mount.lustre.0 Request processed in 247us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969553.985029:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783969553.985130:0:15465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280615168:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783969553.985199:0:15465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1783969553.985220:0:15465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1783969553.986706:0:15476:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1783969553.986723:0:15476:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ac7c1fb99c0) 00000020:00000080:3.0:1783969553.986745:0:15476:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1783969553.986943:0:15476:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ac79e0fc000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783969553.986948:0:15476:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ac79e0fc000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783969553.986950:0:15476:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ac79e0fc000 3 00010000:00080000:3.0:1783969553.986976:0:15476:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ac7a76d8800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.139@tcp at head 00010000:00010000:3.0:1783969553.988577:0:15476:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1783969553.988664:0:15476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1783969553.988697:0:15476:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783969553.988710:0:15476:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xbacf56d076fabfee 00000100:00080000:3.0:1783969553.988719:0:15476:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783969553.988725:0:15476:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ac7a76d8800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1783969553.988760:0:15476:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac785314700 x1870627280615296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783969553.988789:0:15476:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783969553.989054:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3284:1870627280615296:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783969553.989123:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783969553.990996:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783969553.991003:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783969553.991007:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ac7c04f7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783969553.991014:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 410 00000100:00080000:1.0:1783969553.991019:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1783969553.991026:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ac7c04f7000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1783969553.991047:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac7c1bbdf80 x1870627280615552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783969553.991105:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1870627280615552:0@lo:8:kworker.0 00000100:00100000:1.0:1783969553.991162:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969553.991225:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280615552 00000100:00100000:1.0:1783969553.991233:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280615552 00000100:00100000:1.0:1783969553.991269:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783969553.991276:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3284:x1870627280615552:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1783969553.991332:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3284:x1870627280615552:12345-0@lo:8:kworker.0 Request processed in 55us (169us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783969553.991340:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783969553.991378:0:3284:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783969553.991385:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9ac7c04f7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783969553.991388:0:3284:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783969553.991391:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1870627280615552:0@lo:8:kworker.0 00000100:00100000:2.0:1783969553.991655:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280615424:0@lo:400:kworker.0 00000100:00100000:2.0:1783969553.991690:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969553.991734:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280615680:0@lo:400:kworker.0 00000100:00100000:2.0:1783969553.991760:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969553.991792:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783969553.991798:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280615808:0@lo:400:kworker.0 00000100:00100000:2.0:1783969553.991820:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969553.991856:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280615296 00000100:00100000:2.0:1783969553.992961:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280615296 00000100:00100000:2.0:1783969553.992998:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280615680 00000100:00100000:2.0:1783969553.993001:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280615680 00000100:00100000:2.0:1783969553.993022:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280615808 00000100:00100000:2.0:1783969553.993024:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280615808 00000100:00100000:2.0:1783969553.993039:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783969553.993057:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1beb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280615680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969553.993121:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1beb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280615680:12345-0@lo:400:kworker.0 Request processed in 65us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969553.993129:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783969553.993143:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783969553.993149:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280615808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969553.993175:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280615808:12345-0@lo:400:kworker.0 Request processed in 26us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969553.993180:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783969553.993190:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783969553.993194:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3284:x1870627280615296:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783969553.993225:0:14163:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:2.0:1783969553.993259:0:14163:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xbacf56d076fabff5 00000004:00100000:2.0:1783969553.993273:0:14163:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783969553.993300:0:14163:0:(import.c:65:import_set_state_nolock()) ffff9ac7a70ed800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783969553.993342:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3284:x1870627280615296:12345-0@lo:38:llog_process_th.0 Request processed in 147us (4220us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969553.993348:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1783969553.993405:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac7c1bbd880 x1870627280615808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969553.993417:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280615808:0@lo:400:kworker.0 00010000:00080000:2.0:1783969553.993428:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac7c1bbce00 x1870627280615680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969553.993436:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280615680:0@lo:400:kworker.0 00010000:00080000:2.0:1783969553.993481:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ac785314700 x1870627280615296/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783969563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969553.993490:0:3284:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783969553.993496:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1783969553.993503:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783969553.993508:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783969553.993510:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9ac7a76d8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783969553.993514:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3284:1870627280615296:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1783969553.993673:0:15476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:1.0:1783969553.995377:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280615424 00000100:00100000:1.0:1783969553.995387:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280615424 00000100:00100000:1.0:1783969553.995437:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783969553.995446:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3286:x1870627280615424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969553.995526:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1be9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3286:x1870627280615424:12345-0@lo:400:kworker.0 Request processed in 81us (3835us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969553.995533:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:1.0:1783969553.995564:0:15465:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1783969553.995593:0:15465:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783969553.995607:0:15465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e800/0xbacf56d076fabfd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabfe0 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969553.995618:0:15465:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e800/0xbacf56d076fabfd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fabfe0 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783969553.995663:0:15465:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783969553.995665:0:15465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783969553.995670:0:15465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783969553.995671:0:15465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783969553.995672:0:15465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783969553.995673:0:15465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783969553.995674:0:15465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783969553.995676:0:15465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783969553.995677:0:15465:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783969553.995680:0:15465:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1783969553.995682:0:15465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783969553.995684:0:15465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783969553.995685:0:15465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783969553.995686:0:15465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783969553.995686:0:15465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783969553.995687:0:15465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783969553.995688:0:15465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783969553.995689:0:15465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783969553.995690:0:15465:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783969553.995708:0:15465:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783969553.995721:0:15465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280615936:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783969553.995758:0:15465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969553.995787:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280615936 00000100:00100000:1.0:1783969553.995791:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280615936 00000100:00100000:1.0:1783969553.995814:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783969553.995820:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c151dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:15465:x1870627280615936:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783969553.995840:0:14158:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1783969553.995852:0:14158:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1783969553.995986:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280615424:0@lo:400:kworker.0 00000100:00100000:1.0:1783969553.996460:0:15465:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b2f3b6c0 going to sleep for 11 seconds 20000000:01000000:2.0:1783969554.019748:0:14158:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783969554.019765:0:14158:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1783969554.019811:0:14178:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783969554.019815:0:14178:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783969554.019837:0:14178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac783de6e00/0xbacf56d076fabffc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969554.019855:0:14178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac786098000/0xbacf56d076fabed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fabecf expref: 19 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969554.019914:0:14178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ac783de6e00/0xbacf56d076fabffc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969554.019956:0:14178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac786098000/0xbacf56d076fabed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076fabecf expref: 19 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969554.019970:0:14178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac786098000/0xbacf56d076fabed6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076fabecf expref: 19 pid: 14155 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969554.019984:0:14178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785315880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14178:1870627280616064:0@lo:104: 00000100:00100000:3.0:1783969554.020048:0:14178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969554.020119:0:14178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac78c7d5180 going to sleep for 11 seconds 00000100:00100000:2.0:1783969554.020162:0:14147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280616064 00000100:00100000:2.0:1783969554.020169:0:14147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280616064 00000100:00100000:2.0:1783969554.020259:0:14147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783969554.020268:0:14147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785314000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c75a22f-689e-4536-9c19-8125b0e8c51a+3:14178:x1870627280616064:12345-0@lo:104: 00010000:00010000:2.0:1783969554.020281:0:14147:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac783de6400/0xbacf56d076fabecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076fabed6 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969554.020335:0:14147:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783969554.020341:0:14147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785314000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5c75a22f-689e-4536-9c19-8125b0e8c51a+3:14178:x1870627280616064:12345-0@lo:104: Request processed in 75us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969554.020348:0:14147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1783969554.020398:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969554.020405:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac783de6400/0xbacf56d076fabecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076fabed6 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969554.020428:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6400 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:2.0:1783969554.020432:0:14151:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac783de6400/0xbacf56d076fabecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076fabed6 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969554.020440:0:14151:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac783de6400/0xbacf56d076fabecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076fabed6 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783969554.020447:0:14151:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac783de6400/0xbacf56d076fabecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076fabed6 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783969554.020452:0:14151:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783969554.020513:0:14151:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac783de6400/0xbacf56d076fabecf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076fabed6 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969554.020525:0:14151:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783969554.020553:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac783de6400/0xbacf56d076fabecf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076fabed6 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969554.020560:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac783de6400/0xbacf56d076fabecf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076fabed6 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969554.020561:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783969554.020573:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1be8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c75a22f-689e-4536-9c19-8125b0e8c51a:3286:1870627280616192:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783969554.020577:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969554.020578:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969554.020580:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969554.020603:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969554.020605:0:14178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785315880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14178:1870627280616064:0@lo:104: 00010000:00010000:2.0:1783969554.020621:0:14178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ac783de6e00/0xbacf56d076fabffc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969554.020715:0:14150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280616192 00000100:00100000:1.0:1783969554.020720:0:14150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280616192 00010000:00010000:1.0:1783969554.020781:0:14150:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac786098000/0xbacf56d076fabed6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076fabecf expref: 20 pid: 14155 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969554.020822:0:14150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783969554.020830:0:14150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c75a22f-689e-4536-9c19-8125b0e8c51a+20:3286:x1870627280616192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783969554.020841:0:14150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969554.020846:0:14150:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac786098000/0xbacf56d076fabed6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076fabecf expref: 20 pid: 14155 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969554.021017:0:14150:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac786098000/0xbacf56d076fabed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076fabecf expref: 20 pid: 14155 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969554.021033:0:14150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac786098000/0xbacf56d076fabed6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076fabecf expref: 20 pid: 14155 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969554.021046:0:14150:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ac783de6e00/0xbacf56d076fabffc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969554.021123:0:14150:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac783de6e00/0xbacf56d076fabffc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783969554.021136:0:14150:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001554678s 00010000:00010000:1.0:1783969554.021140:0:14150:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac783de6e00/0xbacf56d076fabffc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969554.021146:0:14150:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac783de6e00/0xbacf56d076fabffc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969554.021151:0:14150:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac783de6e00/0xbacf56d076fabffc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969554.021158:0:14150:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac783de6e00/0xbacf56d076fabffc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969554.021829:0:14150:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6e00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969554.021834:0:14150:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac783de6e00/0xbacf56d076fabffc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969554.021841:0:14150:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac783de6e00/0xbacf56d076fabffc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969554.021991:0:14150:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac783de6e00/0xbacf56d076fabffc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969554.022004:0:14150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783969554.022072:0:14178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ac783de6e00/0xbacf56d076fabffc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969554.022088:0:14178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac783de6e00/0xbacf56d076fabffc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969554.022094:0:14178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac783de6e00/0xbacf56d076fabffc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969554.022140:0:14150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:3286:x1870627280616192:12345-0@lo:103:ldlm_bl.0 Request processed in 1309us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969554.022148:0:14150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783969554.022152:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1be8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c75a22f-689e-4536-9c19-8125b0e8c51a:3286:1870627280616192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783969554.036698:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c151dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+18:15465:x1870627280615936:12345-0@lo:253:mount.lustre.0 Request processed in 40871us (40931us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969554.036711:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783969554.036796:0:15465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5c75a22f-689e-4536-9c19-8125b0e8c51a:15465:1870627280615936:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783969554.036810:0:15465:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783969554.036813:0:15465:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783969554.036814:0:15465:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783969554.036816:0:15465:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783969554.036817:0:15465:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783969554.036818:0:15465:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783969554.036819:0:15465:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783969554.036821:0:15465:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783969554.036822:0:15465:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783969554.036823:0:15465:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783969554.036839:0:15465:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1783969554.044846:0:15465:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1783969554.050947:0:15465:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1783969554.051202:0:15465:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1783969554.051378:0:15465:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1783969554.055241:0:15465:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1783969554.058389:0:15465:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1783969554.063835:0:15465:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1783969554.168113:0:15465:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1783969554.168120:0:15465:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1783969554.168148:0:15465:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783969554.168204:0:15465:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.139@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783969554.168228:0:15465:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1783969554.168256:0:15465:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1783969554.213979:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969555.236961:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783969555.685996:0:14160:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783969555.686003:0:14160:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9ac7c1809000 from 8 10000000:01000000:1.0:1783969555.686008:0:14160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783969555.686050:0:14160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f200/0xbacf56d076fac003 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969555.686074:0:14160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f200/0xbacf56d076fac003 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969555.686085:0:14160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f200/0xbacf56d076fac003 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969555.686110:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280616320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783969555.686177:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969555.686239:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b2f3b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783969555.686247:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280616320 00000100:00100000:2.0:1783969555.686256:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280616320 00000100:00100000:2.0:1783969555.686312:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783969555.686321:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c151c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+18:14160:x1870627280616320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969555.686333:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969555.686348:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac786099a00/0xbacf56d076fac00a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076fac003 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969555.686371:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac786099a00/0xbacf56d076fac00a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076fac003 expref: 19 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969555.686392:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac786099a00/0xbacf56d076fac00a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fac003 expref: 19 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969555.686401:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786099a00, rc 0) 00000100:00100000:2.0:1783969555.686849:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c151c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:14160:x1870627280616320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 528us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969555.686893:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783969555.687583:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280616320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783969555.687605:0:14160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f200/0xbacf56d076fac003 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fac00a expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969555.687616:0:14160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f200/0xbacf56d076fac003 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076fac00a expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969555.687788:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280616448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783969555.687837:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969555.687945:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b2f3b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969555.688052:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280616448 00000100:00100000:0.0:1783969555.688058:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280616448 00000100:00100000:0.0:1783969555.688106:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783969555.688115:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c151c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:14160:x1870627280616448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783969555.688132:0:14158:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783969555.688147:0:14158:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783969555.688150:0:14158:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1783969555.688249:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c151c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:14160:x1870627280616448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969555.688255:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783969555.688397:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280616448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783969555.688451:0:14160:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783969555.688476:0:14160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f200/0xbacf56d076fac003 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fac00a expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969555.688485:0:14160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60f200/0xbacf56d076fac003 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fac00a expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969556.272331:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783969556.729976:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1783969556.729999:0:6622:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:2.0:1783969557.285957:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969558.122279:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969558.122301:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280616576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969558.122367:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969558.122430:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280616576 00000100:00100000:3.0:1783969558.122437:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280616576 00000100:00100000:3.0:1783969558.122487:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783969558.122508:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785314380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280616576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783969558.122541:0:14801:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783969558.122584:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785314380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280616576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969558.122591:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1783969558.122609:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969558.122635:0:3285:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1783969558.122655:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280616576:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783969558.309197:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783969559.146232:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783969559.146238:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783969559.146242:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ac7c04f7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783969559.146254:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ac7c04f7000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1783969559.146277:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ac785316300 x1870627280616960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783969559.146336:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1870627280617088:0@lo:400:kworker.0 00000100:00100000:3.0:1783969559.146477:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969559.146533:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969559.146539:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280617216:0@lo:400:kworker.0 00000100:00100000:3.0:1783969559.146567:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969559.146686:0:3284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1870627280616960:0@lo:8:kworker.0 00000100:00100000:3.0:1783969559.146720:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969559.146753:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280616832:0@lo:400:kworker.0 00000100:00100000:3.0:1783969559.146776:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969559.146796:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783969559.146802:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c75a22f-689e-4536-9c19-8125b0e8c51a:3288:1870627280616704:0@lo:400:kworker.0 00000100:00100000:3.0:1783969559.146840:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969559.146887:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1870627280617344:0@lo:400:kworker.0 00000100:00100000:3.0:1783969559.146914:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969559.147042:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280617088 00000100:00100000:3.0:1783969559.147050:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280617088 00000100:00100000:3.0:1783969559.147109:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280617216 00000100:00100000:3.0:1783969559.147112:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280617216 00000100:00100000:3.0:1783969559.147134:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280617344 00000100:00100000:3.0:1783969559.147137:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280617344 00000100:00100000:3.0:1783969559.147152:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783969559.147160:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1870627280617088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969559.147220:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1870627280617088:12345-0@lo:400:kworker.0 Request processed in 59us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969559.147227:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783969559.147241:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783969559.147247:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280617216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969559.147274:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280617216:12345-0@lo:400:kworker.0 Request processed in 28us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969559.147279:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783969559.147288:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783969559.147294:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870627280617344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969559.147320:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1870627280617344:12345-0@lo:400:kworker.0 Request processed in 26us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969559.147325:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1783969559.147344:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783969559.147365:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac785317b80 x1870627280617344/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969559.147388:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3288:1870627280617344:0@lo:400:kworker.0 00010000:00080000:3.0:1783969559.147414:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac785316a00 x1870627280617216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969559.147421:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785316a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280617216:0@lo:400:kworker.0 00010000:00080000:3.0:1783969559.147429:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac785315f80 x1870627280617088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783969559.147435:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785315f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1870627280617088:0@lo:400:kworker.0 00000100:00100000:3.0:1783969559.147464:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280616704 00000100:00100000:3.0:1783969559.147468:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280616704 00000100:00100000:3.0:1783969559.147493:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783969559.147499:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c151d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:3288:x1870627280616704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969559.147536:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c151d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:3288:x1870627280616704:12345-0@lo:400:kworker.0 Request processed in 37us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969559.147542:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783969559.147572:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c75a22f-689e-4536-9c19-8125b0e8c51a:3288:1870627280616704:0@lo:400:kworker.0 00000100:00100000:1.0:1783969559.150667:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280616960 00000100:00100000:1.0:1783969559.150683:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280616960 00000100:00100000:1.0:1783969559.150717:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280616832 00000100:00100000:1.0:1783969559.150720:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280616832 00000100:00100000:1.0:1783969559.150751:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783969559.150759:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280616832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969559.150845:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785314700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280616832:12345-0@lo:400:kworker.0 Request processed in 86us (4067us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969559.150880:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783969559.150898:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783969559.150902:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3284:x1870627280616960:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1783969559.150926:0:14797:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 416 last 0 00000020:00000080:1.0:1783969559.150958:0:14797:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbacf56d076fac011 00002000:00100000:1.0:1783969559.150972:0:14797:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ac7861df000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1783969559.150976:0:14797:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1783969559.150979:0:14797:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783969559.151335:0:14797:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783969559.151360:0:14797:0:(import.c:65:import_set_state_nolock()) ffff9ac7861d9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783969559.151423:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785315880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3284:x1870627280616960:12345-0@lo:8:kworker.0 Request processed in 518us (4702us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969559.151431:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1783969559.151482:0:3284:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac785316300 x1870627280616960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783969584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783969559.151499:0:3284:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1783969559.151507:0:3284:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783969559.151512:0:3284:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783969559.151515:0:3284:0:(import.c:65:import_set_state_nolock()) ffff9ac7c04f7000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783969559.151527:0:3284:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783969559.151533:0:3284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785316300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3284:1870627280616960:0@lo:8:kworker.0 00000004:00080000:1.0:1783969559.151582:0:14187:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1783969559.151603:0:14187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14187:1870627280617600:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783969559.151640:0:14187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969559.151669:0:14187:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b2f3be40 going to sleep for 11 seconds 00000100:00100000:1.0:1783969559.151680:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783969559.151689:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280617472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969559.151719:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969559.151745:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280617600 00000100:00100000:1.0:1783969559.151749:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280617600 00000100:00100000:1.0:1783969559.151775:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783969559.151780:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14187:x1870627280617600:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783969559.154263:0:14186:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783969559.154614:0:14186:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 416236754115ns, next at 0ns, rc = 0 00000100:00100000:2.0:1783969559.159976:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280617472 00000100:00100000:2.0:1783969559.159991:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280617472 00000100:00100000:2.0:1783969559.160048:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783969559.160058:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1870627280617472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783969559.160095:0:14801:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783969559.160190:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1870627280617472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (8469us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969559.160197:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1783969559.160221:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783969559.160257:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280616832:0@lo:400:kworker.0 00010000:00080000:1.0:1783969559.167003:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7c1bbf800 x1870627280617472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783969575 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783969559.167031:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280617472:0@lo:13:osp-pre-1-0.0 00002000:00080000:1.0:1783969559.173160:0:14797:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1783969559.173174:0:14797:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1783969559.173188:0:14797:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:1.0:1783969559.195743:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783969559.195754:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3c6ba47/0xbacf56d076fac018 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.195772:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1783969559.195777:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969559.195783:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3c6ba47/0xbacf56d076fac018 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.195800:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3c6ba47/0xbacf56d076fac018 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.195810:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3c6ba47/0xbacf56d076fac018 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.195826:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3c6ba47/0xbacf56d076fac018 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.195845:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969559.195879:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969559.195885:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3c6ba47/0xbacf56d076fac018 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.195894:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60ee00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969559.195898:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3c6ba47/0xbacf56d076fac018 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.195908:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3c6ba47/0xbacf56d076fac018 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.195926:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3c6ba47/0xbacf56d076fac018 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.195934:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3c6ba47/0xbacf56d076fac018 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.195950:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.195952:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.195954:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783969559.198012:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783969559.198029:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c06c95d0/0xbacf56d076fac01f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.198045:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1783969559.198050:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969559.198056:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c06c95d0/0xbacf56d076fac01f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.198069:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c06c95d0/0xbacf56d076fac01f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.198078:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c06c95d0/0xbacf56d076fac01f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.198086:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c06c95d0/0xbacf56d076fac01f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.198100:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969559.198111:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969559.198116:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c06c95d0/0xbacf56d076fac01f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.198123:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60e200 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969559.198127:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c06c95d0/0xbacf56d076fac01f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.198135:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c06c95d0/0xbacf56d076fac01f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.198155:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c06c95d0/0xbacf56d076fac01f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.198162:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c06c95d0/0xbacf56d076fac01f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.198191:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.198193:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.198195:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783969559.198779:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783969559.198786:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1697cf9/0xbacf56d076fac026 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.198796:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1783969559.198800:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969559.198804:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1697cf9/0xbacf56d076fac026 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.198813:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1697cf9/0xbacf56d076fac026 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.198821:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1697cf9/0xbacf56d076fac026 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.198829:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1697cf9/0xbacf56d076fac026 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.198855:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969559.198882:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969559.198887:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1697cf9/0xbacf56d076fac026 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.198894:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60ec00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969559.198898:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1697cf9/0xbacf56d076fac026 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.198906:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1697cf9/0xbacf56d076fac026 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.198917:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1697cf9/0xbacf56d076fac026 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.198924:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1697cf9/0xbacf56d076fac026 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.198936:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.198937:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.198939:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783969559.200006:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783969559.200016:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0f3cda3/0xbacf56d076fac02d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.200028:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1783969559.200037:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969559.200043:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0f3cda3/0xbacf56d076fac02d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.200055:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0f3cda3/0xbacf56d076fac02d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.200064:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0f3cda3/0xbacf56d076fac02d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.200072:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0f3cda3/0xbacf56d076fac02d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.200085:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969559.200097:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969559.200101:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0f3cda3/0xbacf56d076fac02d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.200107:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60f000 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969559.200111:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0f3cda3/0xbacf56d076fac02d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.200119:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0f3cda3/0xbacf56d076fac02d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.200130:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0f3cda3/0xbacf56d076fac02d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.200147:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0f3cda3/0xbacf56d076fac02d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.200160:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.200161:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.200163:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783969559.200646:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783969559.200652:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052d4f2e4/0xbacf56d076fac034 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.200660:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1783969559.200663:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969559.200667:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052d4f2e4/0xbacf56d076fac034 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.200678:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052d4f2e4/0xbacf56d076fac034 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.200686:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052d4f2e4/0xbacf56d076fac034 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.200693:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052d4f2e4/0xbacf56d076fac034 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.200708:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969559.200716:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969559.200725:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052d4f2e4/0xbacf56d076fac034 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.200732:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60fa00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969559.200735:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052d4f2e4/0xbacf56d076fac034 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.200742:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052d4f2e4/0xbacf56d076fac034 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.200752:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052d4f2e4/0xbacf56d076fac034 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.200759:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052d4f2e4/0xbacf56d076fac034 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.200771:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.200773:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.200774:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783969559.201193:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783969559.201200:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fa0a561/0xbacf56d076fac03b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.201209:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1783969559.201211:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969559.201215:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fa0a561/0xbacf56d076fac03b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.201236:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fa0a561/0xbacf56d076fac03b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.201244:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fa0a561/0xbacf56d076fac03b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.201251:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fa0a561/0xbacf56d076fac03b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.201266:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969559.201276:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969559.201279:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fa0a561/0xbacf56d076fac03b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.201286:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60ea00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969559.201288:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fa0a561/0xbacf56d076fac03b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.201296:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fa0a561/0xbacf56d076fac03b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.201306:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fa0a561/0xbacf56d076fac03b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.201312:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fa0a561/0xbacf56d076fac03b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.201332:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.201334:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.201335:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783969559.201705:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783969559.201711:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053e9be5a/0xbacf56d076fac042 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.201719:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1783969559.201723:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969559.201727:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053e9be5a/0xbacf56d076fac042 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.201736:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053e9be5a/0xbacf56d076fac042 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.201744:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053e9be5a/0xbacf56d076fac042 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.201751:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053e9be5a/0xbacf56d076fac042 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.201764:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969559.201772:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969559.201775:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053e9be5a/0xbacf56d076fac042 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.201792:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60e400 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969559.201795:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053e9be5a/0xbacf56d076fac042 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.201802:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053e9be5a/0xbacf56d076fac042 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.201812:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053e9be5a/0xbacf56d076fac042 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.201819:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053e9be5a/0xbacf56d076fac042 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.201831:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.201833:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.201834:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783969559.202245:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783969559.202251:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1eee168/0xbacf56d076fac049 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.202259:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1783969559.202262:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969559.202266:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1eee168/0xbacf56d076fac049 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.202276:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1eee168/0xbacf56d076fac049 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.202292:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1eee168/0xbacf56d076fac049 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.202299:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1eee168/0xbacf56d076fac049 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.202314:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969559.202323:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969559.202327:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1eee168/0xbacf56d076fac049 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.202333:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60f400 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969559.202336:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1eee168/0xbacf56d076fac049 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.202344:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1eee168/0xbacf56d076fac049 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.202355:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1eee168/0xbacf56d076fac049 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.202361:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1eee168/0xbacf56d076fac049 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.202374:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.202381:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.202383:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783969559.202770:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783969559.202775:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c77b7753/0xbacf56d076fac050 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.202783:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1783969559.202786:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969559.202790:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c77b7753/0xbacf56d076fac050 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.202798:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c77b7753/0xbacf56d076fac050 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.202805:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c77b7753/0xbacf56d076fac050 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.202811:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c77b7753/0xbacf56d076fac050 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.202824:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969559.202831:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969559.202834:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c77b7753/0xbacf56d076fac050 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.202839:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60fe00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969559.202842:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c77b7753/0xbacf56d076fac050 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.202880:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c77b7753/0xbacf56d076fac050 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.202891:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c77b7753/0xbacf56d076fac050 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.202898:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c77b7753/0xbacf56d076fac050 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.202909:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.202911:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.202912:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783969559.205742:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783969559.205754:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058ab8da8/0xbacf56d076fac057 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.205771:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1783969559.205775:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969559.205782:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058ab8da8/0xbacf56d076fac057 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.205796:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058ab8da8/0xbacf56d076fac057 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.205806:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058ab8da8/0xbacf56d076fac057 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.205820:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058ab8da8/0xbacf56d076fac057 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.205843:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969559.205876:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969559.205881:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058ab8da8/0xbacf56d076fac057 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.205889:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac683624400 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969559.205893:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058ab8da8/0xbacf56d076fac057 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.205902:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058ab8da8/0xbacf56d076fac057 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.205919:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058ab8da8/0xbacf56d076fac057 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.205926:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058ab8da8/0xbacf56d076fac057 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.205941:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.205942:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.205944:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783969559.209385:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783969559.210046:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bb0f594/0xbacf56d076fac05e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.210065:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=416s v=(0 0) 00010000:00010000:1.0:1783969559.210070:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969559.210076:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bb0f594/0xbacf56d076fac05e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.210091:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bb0f594/0xbacf56d076fac05e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.210102:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bb0f594/0xbacf56d076fac05e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.210110:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bb0f594/0xbacf56d076fac05e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.219907:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969559.220630:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969559.220640:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bb0f594/0xbacf56d076fac05e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.220653:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac683625000 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969559.220658:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bb0f594/0xbacf56d076fac05e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.220669:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bb0f594/0xbacf56d076fac05e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.220701:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bb0f594/0xbacf56d076fac05e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.220708:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bb0f594/0xbacf56d076fac05e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.220727:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.220729:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.220732:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969559.221271:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969559.221280:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2dec94e/0xbacf56d076fac065 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.221299:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1783969559.221304:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969559.221310:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2dec94e/0xbacf56d076fac065 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.221324:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2dec94e/0xbacf56d076fac065 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.221334:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2dec94e/0xbacf56d076fac065 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.221342:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2dec94e/0xbacf56d076fac065 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.221358:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783969559.222979:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969559.222989:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fac06c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.223003:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1783969559.223007:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969559.223013:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fac06c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.223024:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fac06c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.223045:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fac06c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.223053:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fac06c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.223069:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783969559.224005:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783969559.224014:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2dec94e/0xbacf56d076fac065 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.224024:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92c00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969559.224029:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2dec94e/0xbacf56d076fac065 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.224038:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2dec94e/0xbacf56d076fac065 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.224056:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2dec94e/0xbacf56d076fac065 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.224063:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2dec94e/0xbacf56d076fac065 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.224097:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969559.224101:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fac06c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.224108:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93c00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969559.224111:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fac06c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.224120:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fac06c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.224130:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fac06c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.224137:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fac06c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.224149:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.224151:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.224152:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.224159:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969559.225307:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969559.225319:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000340f7ec7/0xbacf56d076fac073 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.225334:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1783969559.225338:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969559.225343:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000340f7ec7/0xbacf56d076fac073 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.225355:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000340f7ec7/0xbacf56d076fac073 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.225365:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000340f7ec7/0xbacf56d076fac073 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.225373:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000340f7ec7/0xbacf56d076fac073 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.225807:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783969559.225819:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969559.225824:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000340f7ec7/0xbacf56d076fac073 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.225832:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92400 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969559.225835:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000340f7ec7/0xbacf56d076fac073 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.225843:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000340f7ec7/0xbacf56d076fac073 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.225856:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000340f7ec7/0xbacf56d076fac073 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.225919:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000340f7ec7/0xbacf56d076fac073 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.225933:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969559.225935:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969559.225936:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969559.230032:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969559.230047:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4b79086/0xbacf56d076fac07a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.230065:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1783969559.230079:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969559.230086:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4b79086/0xbacf56d076fac07a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.230101:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4b79086/0xbacf56d076fac07a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.230112:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4b79086/0xbacf56d076fac07a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.230120:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4b79086/0xbacf56d076fac07a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.230134:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969559.231340:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969559.231350:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4b79086/0xbacf56d076fac07a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.231362:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93000 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969559.231374:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4b79086/0xbacf56d076fac07a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.231384:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4b79086/0xbacf56d076fac07a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.231855:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4b79086/0xbacf56d076fac07a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.231882:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4b79086/0xbacf56d076fac07a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.231903:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.231905:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.231907:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969559.234349:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969559.234363:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb167ace/0xbacf56d076fac081 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.234379:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1783969559.234384:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969559.237505:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb167ace/0xbacf56d076fac081 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.237529:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb167ace/0xbacf56d076fac081 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.237542:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb167ace/0xbacf56d076fac081 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.237559:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb167ace/0xbacf56d076fac081 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.237577:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783969559.237592:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969559.237597:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb167ace/0xbacf56d076fac081 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.237605:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93600 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969559.237610:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb167ace/0xbacf56d076fac081 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.237619:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb167ace/0xbacf56d076fac081 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.237636:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb167ace/0xbacf56d076fac081 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.237644:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb167ace/0xbacf56d076fac081 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.237663:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969559.237665:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969559.237667:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969559.238195:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969559.238209:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa6c4149/0xbacf56d076fac088 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.238220:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1783969559.238224:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969559.238229:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa6c4149/0xbacf56d076fac088 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.238239:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa6c4149/0xbacf56d076fac088 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.238248:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa6c4149/0xbacf56d076fac088 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.238255:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa6c4149/0xbacf56d076fac088 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.238267:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969559.240286:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969559.240301:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa6c4149/0xbacf56d076fac088 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.240314:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92000 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969559.240319:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa6c4149/0xbacf56d076fac088 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.240330:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa6c4149/0xbacf56d076fac088 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.240350:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa6c4149/0xbacf56d076fac088 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.240365:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa6c4149/0xbacf56d076fac088 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783969559.240919:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969559.240928:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fac08f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.240940:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1783969559.240944:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969559.240950:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fac08f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.240962:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fac08f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.240977:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fac08f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.240984:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fac08f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.241000:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783969559.241013:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969559.241017:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fac08f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.241024:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93c00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969559.241028:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fac08f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.241035:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fac08f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.241047:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fac08f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.241055:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd694e52/0xbacf56d076fac08f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.241069:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969559.241076:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969559.241078:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.241430:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.241433:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.241435:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969559.244591:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969559.244604:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2dec94e/0xbacf56d076fac096 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.244620:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1783969559.244624:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969559.244630:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2dec94e/0xbacf56d076fac096 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.244643:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2dec94e/0xbacf56d076fac096 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.244653:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2dec94e/0xbacf56d076fac096 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.244661:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2dec94e/0xbacf56d076fac096 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.244677:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783969559.244689:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969559.244694:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2dec94e/0xbacf56d076fac096 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.244701:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb92c00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969559.244704:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2dec94e/0xbacf56d076fac096 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.244725:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2dec94e/0xbacf56d076fac096 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.244740:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2dec94e/0xbacf56d076fac096 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.244748:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2dec94e/0xbacf56d076fac096 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.244766:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969559.244767:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969559.244769:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969559.245258:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969559.245265:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e95a3971/0xbacf56d076fac09d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.245274:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1783969559.245277:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969559.245281:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e95a3971/0xbacf56d076fac09d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.245289:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e95a3971/0xbacf56d076fac09d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.245297:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e95a3971/0xbacf56d076fac09d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.245315:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e95a3971/0xbacf56d076fac09d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.248944:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783969559.251693:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969559.251705:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e976f1f/0xbacf56d076fac0a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.251722:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1783969559.251727:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969559.251733:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e976f1f/0xbacf56d076fac0a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.251749:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e976f1f/0xbacf56d076fac0a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.251759:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e976f1f/0xbacf56d076fac0a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.251767:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e976f1f/0xbacf56d076fac0a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.251789:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783969559.251802:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783969559.251808:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e95a3971/0xbacf56d076fac09d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.251823:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac681129800 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969559.251828:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e95a3971/0xbacf56d076fac09d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.251837:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e95a3971/0xbacf56d076fac09d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.251854:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e95a3971/0xbacf56d076fac09d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.251889:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e95a3971/0xbacf56d076fac09d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.251908:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969559.251911:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e976f1f/0xbacf56d076fac0a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.251918:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac681129c00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969559.251921:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e976f1f/0xbacf56d076fac0a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.251928:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e976f1f/0xbacf56d076fac0a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.251937:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e976f1f/0xbacf56d076fac0a4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.251950:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e976f1f/0xbacf56d076fac0a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.251963:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969559.251964:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969559.251966:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.258122:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969559.265953:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969559.265968:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043f62b82/0xbacf56d076fac0ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.265987:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1783969559.265991:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969559.265999:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043f62b82/0xbacf56d076fac0ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.266012:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043f62b82/0xbacf56d076fac0ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.266022:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043f62b82/0xbacf56d076fac0ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.266030:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043f62b82/0xbacf56d076fac0ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.266049:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783969559.266062:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969559.266074:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043f62b82/0xbacf56d076fac0ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.266082:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac681128400 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969559.266087:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043f62b82/0xbacf56d076fac0ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.266096:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043f62b82/0xbacf56d076fac0ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.266113:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043f62b82/0xbacf56d076fac0ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.266121:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043f62b82/0xbacf56d076fac0ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.266136:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969559.266138:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969559.266139:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969559.267633:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969559.267642:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000086e6a98/0xbacf56d076fac0b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.267657:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1783969559.267660:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969559.267666:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000086e6a98/0xbacf56d076fac0b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.267690:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000086e6a98/0xbacf56d076fac0b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.267699:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000086e6a98/0xbacf56d076fac0b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.267706:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000086e6a98/0xbacf56d076fac0b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.267721:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783969559.268158:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969559.268164:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041f45b08/0xbacf56d076fac0b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.268173:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1783969559.268188:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969559.268193:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041f45b08/0xbacf56d076fac0b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.268202:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041f45b08/0xbacf56d076fac0b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.268210:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041f45b08/0xbacf56d076fac0b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.268228:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041f45b08/0xbacf56d076fac0b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.268241:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783969559.268253:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783969559.268257:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000086e6a98/0xbacf56d076fac0b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.268264:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac681129000 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969559.268268:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000086e6a98/0xbacf56d076fac0b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.268276:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000086e6a98/0xbacf56d076fac0b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.268291:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000086e6a98/0xbacf56d076fac0b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.268298:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000086e6a98/0xbacf56d076fac0b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.268311:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969559.268313:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041f45b08/0xbacf56d076fac0b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.268329:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac681128600 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969559.268333:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041f45b08/0xbacf56d076fac0b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.268339:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041f45b08/0xbacf56d076fac0b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.268350:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041f45b08/0xbacf56d076fac0b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.268356:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041f45b08/0xbacf56d076fac0b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.268368:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969559.268369:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969559.268371:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969559.270067:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969559.270077:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007aed4897/0xbacf56d076fac0c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.270092:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1783969559.270096:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969559.270102:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007aed4897/0xbacf56d076fac0c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.270114:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007aed4897/0xbacf56d076fac0c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.270128:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007aed4897/0xbacf56d076fac0c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.270135:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007aed4897/0xbacf56d076fac0c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.270150:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783969559.270161:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783969559.270167:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007aed4897/0xbacf56d076fac0c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.270182:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac681129600 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969559.270186:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007aed4897/0xbacf56d076fac0c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.270195:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007aed4897/0xbacf56d076fac0c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.270210:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007aed4897/0xbacf56d076fac0c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.270217:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007aed4897/0xbacf56d076fac0c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.270233:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969559.270240:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783969559.270242:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.271337:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969559.275309:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969559.275321:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e86ada51/0xbacf56d076fac0c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.275340:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1783969559.275345:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969559.275351:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e86ada51/0xbacf56d076fac0c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.275365:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e86ada51/0xbacf56d076fac0c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.275376:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e86ada51/0xbacf56d076fac0c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.275451:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e86ada51/0xbacf56d076fac0c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.275478:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969559.275702:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969559.275711:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e86ada51/0xbacf56d076fac0c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.275722:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac681128e00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969559.275727:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e86ada51/0xbacf56d076fac0c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.275737:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e86ada51/0xbacf56d076fac0c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.275754:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e86ada51/0xbacf56d076fac0c7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.275763:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e86ada51/0xbacf56d076fac0c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.275787:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.275795:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.275798:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969559.275941:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969559.275947:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000183c622c/0xbacf56d076fac0ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.275956:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1783969559.275959:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969559.275964:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000183c622c/0xbacf56d076fac0ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.275982:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000183c622c/0xbacf56d076fac0ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.275990:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000183c622c/0xbacf56d076fac0ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.275998:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000183c622c/0xbacf56d076fac0ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.276013:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783969559.276977:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783969559.276986:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000183c622c/0xbacf56d076fac0ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.276998:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac681128200 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969559.277010:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000183c622c/0xbacf56d076fac0ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.277019:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000183c622c/0xbacf56d076fac0ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.277034:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000183c622c/0xbacf56d076fac0ce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.277041:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000183c622c/0xbacf56d076fac0ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969559.277060:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.277062:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969559.277064:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783969559.278563:0:14797:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783969559.278575:0:14797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009c1c88e/0xbacf56d076fac0d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.278590:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1783969559.278595:0:14797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969559.278601:0:14797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009c1c88e/0xbacf56d076fac0d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.278613:0:14797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009c1c88e/0xbacf56d076fac0d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.278623:0:14797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009c1c88e/0xbacf56d076fac0d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.278643:0:14797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009c1c88e/0xbacf56d076fac0d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969559.278668:0:14797:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1783969559.278958:0:14797:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1783969559.279044:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14187:x1870627280617600:12345-0@lo:5:osp-pre-1-0.0 Request processed in 127260us (127400us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969559.279053:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1783969559.282644:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783969559.282658:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009c1c88e/0xbacf56d076fac0d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969559.282671:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac681129e00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:2.0:1783969559.282676:0:14152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009c1c88e/0xbacf56d076fac0d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969559.282688:0:14152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009c1c88e/0xbacf56d076fac0d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969559.282722:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009c1c88e/0xbacf56d076fac0d5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969559.282730:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009c1c88e/0xbacf56d076fac0d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969559.282753:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969559.282754:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969559.282756:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969559.285802:0:14187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14187:1870627280617600:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1783969559.285822:0:14187:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1783969559.285888:0:14187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14187:1870627280617728:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783969559.285945:0:14187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969559.286003:0:14187:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7b2f3be40 going to sleep for 11 seconds 00000004:00080000:3.0:1783969559.287875:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1783969559.288936:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280617728 00000100:00100000:1.0:1783969559.288947:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280617728 00000100:00100000:1.0:1783969559.289000:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783969559.289010:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14187:x1870627280617728:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1783969559.289054:0:14798:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000001:00100000:2.0:1783969559.297366:0:7494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1783969559.302432:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14187:x1870627280617728:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13418us (16480us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1783969559.302445:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783969559.302739:0:14187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14187:1870627280617728:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783969559.302754:0:14187:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1783969559.333002:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969560.357974:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783969561.360817:0:15826:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783969561.384092:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783969561.829795:0:14197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783969562.416746:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969563.237128:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280617856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969563.237202:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969563.237314:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280617856 00000100:00100000:3.0:1783969563.237330:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280617856 00000100:00100000:3.0:1783969563.237387:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783969563.237396:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280617856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783969563.237426:0:14801:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783969563.237478:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280617856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969563.237485:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1783969563.237538:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969563.237569:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785315c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280617856:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783969563.434673:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969563.936237:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969563.937302:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272236288 00000100:00100000:0.0:1783969563.937314:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272236288 00000100:00100000:0.0:1783969563.937359:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 76 00000100:00100000:0.0:1783969563.937367:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c151e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2347:x1870627272236288:12345-192.168.203.39@tcp:250:mount.lustre.0 00010000:00080000:0.0:1783969563.937394:0:14157:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 2bdf8e85-d598-4892-bfdb-3f724decfbe5@192.168.203.39@tcp t0 exp 0000000000000000 cur 421 last 0 00000020:00000080:0.0:1783969563.937429:0:14157:0:(genops.c:1406:class_connect()) connect: client 2bdf8e85-d598-4892-bfdb-3f724decfbe5, cookie 0xbacf56d076fac0dc 00000100:00080000:0.0:1783969563.937562:0:14157:0:(import.c:65:import_set_state_nolock()) ffff9ac79e3dd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783969563.937636:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c151e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+5:2347:x1870627272236288:12345-192.168.203.39@tcp:250:mount.lustre.0 Request processed in 268us (1408us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969563.937644:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 76 00000100:00100000:1.0:1783969563.950339:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969563.950438:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272236416 00000100:00100000:3.0:1783969563.950447:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272236416 00000100:00100000:3.0:1783969563.950503:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 77 00000100:00100000:3.0:1783969563.950513:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c151c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bdf8e85-d598-4892-bfdb-3f724decfbe5+5:13700:x1870627272236416:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783969563.950529:0:14158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969563.950547:0:14158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac783de7e00/0xbacf56d076fac0e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb634c2 expref: -99 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969563.950577:0:14158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac783de7e00/0xbacf56d076fac0e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb634c2 expref: 6 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969563.950586:0:14158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac783de7e00/0xbacf56d076fac0e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb634c2 expref: 6 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969563.950595:0:14158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7e00, rc 0) 00000100:00100000:3.0:1783969563.950656:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c151c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bdf8e85-d598-4892-bfdb-3f724decfbe5+6:13700:x1870627272236416:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 144us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969563.950662:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 77 00000100:00100000:2.0:1783969563.958007:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969563.958092:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272236544 00000100:00100000:3.0:1783969563.958102:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272236544 00000100:00100000:3.0:1783969563.958169:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 78 00000100:00100000:3.0:1783969563.958196:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c151fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bdf8e85-d598-4892-bfdb-3f724decfbe5+6:13700:x1870627272236544:12345-192.168.203.39@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783969563.958682:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c151fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bdf8e85-d598-4892-bfdb-3f724decfbe5+6:13700:x1870627272236544:12345-192.168.203.39@tcp:501:mount.lustre.0 Request processed in 487us (746us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783969563.958691:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 78 00000100:00100000:2.0:1783969563.960422:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969563.960609:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272236672 00000100:00100000:1.0:1783969563.960617:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272236672 00000100:00100000:1.0:1783969563.960674:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 79 00000100:00100000:1.0:1783969563.960684:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c151e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+6:13700:x1870627272236672:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783969563.960698:0:14157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969563.960716:0:14157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac683625400/0xbacf56d076fac0ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb634c9 expref: -99 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969563.960742:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac683625400/0xbacf56d076fac0ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb634c9 expref: 7 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969563.960770:0:14157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac683625400/0xbacf56d076fac0ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb634c9 expref: 7 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969563.960780:0:14157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac683625400, rc 0) 00000100:00100000:1.0:1783969563.960830:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c151e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+7:13700:x1870627272236672:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 148us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969563.960836:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 79 00000100:00100000:2.0:1783969563.968233:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969563.973355:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272236800 00000100:00100000:3.0:1783969563.973369:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272236800 00000100:00100000:3.0:1783969563.973436:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 80 00000100:00100000:3.0:1783969563.973447:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c151e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bdf8e85-d598-4892-bfdb-3f724decfbe5+7:13700:x1870627272236800:12345-192.168.203.39@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783969563.973764:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c151e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bdf8e85-d598-4892-bfdb-3f724decfbe5+8:13700:x1870627272236800:12345-192.168.203.39@tcp:501:mount.lustre.0 Request processed in 318us (5539us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969563.973772:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 80 00000100:00100000:2.0:1783969563.980643:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969563.981016:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272236928 00000100:00100000:1.0:1783969563.981129:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272236928 00000100:00100000:2.0:1783969563.981567:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 81 00000100:00100000:2.0:1783969563.981580:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c151d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+8:13700:x1870627272236928:12345-192.168.203.39@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783969563.982598:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c151d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+8:13700:x1870627272236928:12345-192.168.203.39@tcp:503:mount.lustre.0 Request processed in 1016us (1965us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969563.982609:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 81 00000100:00100000:2.0:1783969563.987380:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969563.987554:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272237056 00000100:00100000:3.0:1783969563.987563:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272237056 00000100:00100000:3.0:1783969563.987621:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 82 00000100:00100000:3.0:1783969563.987633:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c151f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bdf8e85-d598-4892-bfdb-3f724decfbe5+8:13719:x1870627272237056:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783969563.988015:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c151f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bdf8e85-d598-4892-bfdb-3f724decfbe5+8:13719:x1870627272237056:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 384us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969563.988025:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 82 00000100:00100000:0.0:1783969564.006442:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969564.007117:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272237184 00000100:00100000:2.0:1783969564.007129:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272237184 00000100:00100000:2.0:1783969564.007215:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 83 00000100:00100000:2.0:1783969564.007226:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac791508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+8:13719:x1870627272237184:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783969564.008830:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac791508050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+8:13719:x1870627272237184:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 1597us (2389us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969564.008843:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 83 00000100:00100000:1.0:1783969564.015662:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969564.015793:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272237312 00000100:00100000:2.0:1783969564.015985:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272237312 00000100:00100000:2.0:1783969564.016080:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 84 00000100:00100000:2.0:1783969564.016090:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c151cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bdf8e85-d598-4892-bfdb-3f724decfbe5+8:13700:x1870627272237312:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783969564.016107:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969564.016124:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac786099000/0xbacf56d076fac0f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb634f3 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969564.016160:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac786099000/0xbacf56d076fac0f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb634f3 expref: 9 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969564.016171:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac786099000/0xbacf56d076fac0f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb634f3 expref: 9 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969564.016179:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786099000, rc 0) 00000100:00100000:2.0:1783969564.016234:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c151cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bdf8e85-d598-4892-bfdb-3f724decfbe5+9:13700:x1870627272237312:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 145us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969564.016241:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 84 00000100:00100000:3.0:1783969564.019392:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969564.021760:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272237440 00000100:00100000:0.0:1783969564.021774:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272237440 00000100:00100000:0.0:1783969564.021840:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 85 00000100:00100000:0.0:1783969564.021851:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac791508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+9:13700:x1870627272237440:12345-192.168.203.39@tcp:256:mount.lustre.0 20000000:01000000:0.0:1783969564.021891:0:14157:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783969564.021924:0:14157:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783969564.021928:0:14157:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783969564.021931:0:14157:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783969564.021933:0:14157:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1783969564.036207:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac791508c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+9:13700:x1870627272237440:12345-192.168.203.39@tcp:256:mount.lustre.0 Request processed in 14348us (16813us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969564.036221:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 85 00000100:00100000:1.0:1783969564.047267:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969564.047431:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272237568 00000100:00100000:2.0:1783969564.047441:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272237568 00000100:00100000:2.0:1783969564.047512:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 86 00000100:00100000:2.0:1783969564.047522:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79150bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bdf8e85-d598-4892-bfdb-3f724decfbe5+9:13700:x1870627272237568:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783969564.047549:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969564.047745:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac786099600/0xbacf56d076fac0f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb634fa expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969564.047777:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac786099600/0xbacf56d076fac0f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb634fa expref: 10 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969564.047789:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac786099600/0xbacf56d076fac0f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb634fa expref: 10 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969564.047800:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786099600, rc 0) 00000100:00100000:2.0:1783969564.047898:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79150bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bdf8e85-d598-4892-bfdb-3f724decfbe5+10:13700:x1870627272237568:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 340us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969564.047907:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 86 00000100:00100000:1.0:1783969564.050963:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969564.051058:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272237696 00000100:00100000:0.0:1783969564.051066:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272237696 00000100:00100000:0.0:1783969564.051114:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 87 00000100:00100000:0.0:1783969564.051123:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac791509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+10:13700:x1870627272237696:12345-192.168.203.39@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783969564.051402:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac791509050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+10:13700:x1870627272237696:12345-192.168.203.39@tcp:501:mount.lustre.0 Request processed in 279us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969564.051410:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 87 00000100:00100000:3.0:1783969564.055330:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969564.058195:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272237824 00000100:00100000:2.0:1783969564.058210:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272237824 00000100:00100000:2.0:1783969564.058282:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 88 00000100:00100000:2.0:1783969564.058292:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac79150a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bdf8e85-d598-4892-bfdb-3f724decfbe5+10:13700:x1870627272237824:12345-192.168.203.39@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783969564.058700:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac79150a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bdf8e85-d598-4892-bfdb-3f724decfbe5+10:13700:x1870627272237824:12345-192.168.203.39@tcp:503:mount.lustre.0 Request processed in 408us (3377us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969564.058710:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 88 00000100:00100000:2.0:1783969564.063060:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969564.063168:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272237952 00000100:00100000:1.0:1783969564.063177:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272237952 00000100:00100000:1.0:1783969564.063229:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 89 00000100:00100000:1.0:1783969564.063238:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7883c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bdf8e85-d598-4892-bfdb-3f724decfbe5+10:13723:x1870627272237952:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783969564.063538:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7883c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bdf8e85-d598-4892-bfdb-3f724decfbe5+10:13723:x1870627272237952:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 301us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969564.063547:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 89 00000100:00100000:1.0:1783969564.065966:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969564.066053:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272238080 00000100:00100000:0.0:1783969564.066061:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272238080 00000100:00100000:0.0:1783969564.066110:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 90 00000100:00100000:0.0:1783969564.066120:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7883c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+10:13723:x1870627272238080:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783969564.066480:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7883c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+10:13723:x1870627272238080:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 360us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969564.066488:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 90 00000100:00100000:3.0:1783969564.073116:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969564.073541:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272238208 00000100:00100000:2.0:1783969564.073551:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272238208 00000100:00100000:2.0:1783969564.073606:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:2.0:1783969564.073614:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2347:x1870627272238208:12345-192.168.203.39@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783969564.073644:0:14821:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 6fcda0ab-5b57-4e8f-beca-401d3c9668a1@192.168.203.39@tcp t0 exp 0000000000000000 cur 421 last 0 00000020:00000080:2.0:1783969564.073702:0:14821:0:(genops.c:1406:class_connect()) connect: client 6fcda0ab-5b57-4e8f-beca-401d3c9668a1, cookie 0xbacf56d076fac0ff 00000004:00100000:2.0:1783969564.073730:0:14821:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:2.0:1783969564.073735:0:14821:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1783969564.116632:0:14821:0:(import.c:65:import_set_state_nolock()) ffff9ac786168000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783969564.116763:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+6:2347:x1870627272238208:12345-192.168.203.39@tcp:38:mount.lustre.0 Request processed in 43146us (43653us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969564.116774:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:2.0:1783969564.125309:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969564.125907:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272238464 00000100:00100000:3.0:1783969564.125920:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272238464 00000100:00100000:3.0:1783969564.125997:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:3.0:1783969564.126008:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+6:13700:x1870627272238464:12345-192.168.203.39@tcp:41:mount.lustre.0 00000100:00080000:1.0:1783969564.126082:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1783969564.126268:0:14164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1783969564.126346:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+6:13700:x1870627272238464:12345-192.168.203.39@tcp:41:mount.lustre.0 Request processed in 339us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969564.126354:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:2.0:1783969564.129387:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969564.130045:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272238592 00000100:00100000:3.0:1783969564.130055:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272238592 00000100:00100000:3.0:1783969564.130113:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:3.0:1783969564.130122:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+6:13700:x1870627272238592:12345-192.168.203.39@tcp:40:mount.lustre.0 00000100:00100000:3.0:1783969564.130225:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+6:13700:x1870627272238592:12345-192.168.203.39@tcp:40:mount.lustre.0 Request processed in 102us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969564.130232:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:3.0:1783969564.133690:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969564.133815:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272238336 00000100:00100000:2.0:1783969564.133825:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272238336 00000100:00100000:2.0:1783969564.133910:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:2.0:1783969564.133921:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+6:0:x1870627272238336:12345-192.168.203.39@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783969564.133954:0:14162:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783969564.134016:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+6:0:x1870627272238336:12345-192.168.203.39@tcp:41:mount.lustre.0 Request processed in 97us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969564.134024:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:2.0:1783969564.138087:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969564.138194:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272238976 00000100:00100000:3.0:1783969564.138204:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272238976 00000100:00100000:3.0:1783969564.138260:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:3.0:1783969564.138269:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+6:13700:x1870627272238976:12345-192.168.203.39@tcp:33:mount.lustre.0 00000004:00080000:1.0:1783969564.144882:0:14165:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 6551us 00000100:00100000:0.0:1783969564.153855:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969564.153984:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000004:00200000:2.0:1783969564.163469:0:14165:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1783969564.164097:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+6:13700:x1870627272238976:12345-192.168.203.39@tcp:33:mount.lustre.0 Request processed in 25823us (26012us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969564.164112:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:1.0:1783969564.164824:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272238720 00000100:00100000:1.0:1783969564.164834:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272238720 00000100:00100000:1.0:1783969564.164881:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272238848 00000100:00100000:1.0:1783969564.164884:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272238848 00000100:00100000:1.0:1783969564.164898:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:1.0:1783969564.164904:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2347:x1870627272238720:12345-192.168.203.39@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783969564.164929:0:14797:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 6fcda0ab-5b57-4e8f-beca-401d3c9668a1@192.168.203.39@tcp t0 exp 0000000000000000 cur 421 last 0 00000020:00000080:1.0:1783969564.165092:0:14797:0:(genops.c:1406:class_connect()) connect: client 6fcda0ab-5b57-4e8f-beca-401d3c9668a1, cookie 0xbacf56d076fac106 00002000:00100000:1.0:1783969564.165104:0:14797:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6fcda0ab-5b57-4e8f-beca-401d3c9668a1/ffff9ac682862800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783969564.165114:0:14797:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:1.0:1783969564.165389:0:14797:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783969564.165416:0:14797:0:(import.c:65:import_set_state_nolock()) ffff9ac682860800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783969564.166286:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+6:2347:x1870627272238720:12345-192.168.203.39@tcp:8:mount.lustre.0 Request processed in 1375us (12437us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969564.166296:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:1.0:1783969564.166317:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:1.0:1783969564.166323:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2347:x1870627272238848:12345-192.168.203.39@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783969564.166346:0:14797:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 6fcda0ab-5b57-4e8f-beca-401d3c9668a1@192.168.203.39@tcp t0 exp 0000000000000000 cur 421 last 0 00000020:00000080:1.0:1783969564.166370:0:14797:0:(genops.c:1406:class_connect()) connect: client 6fcda0ab-5b57-4e8f-beca-401d3c9668a1, cookie 0xbacf56d076fac10d 00002000:00100000:1.0:1783969564.166378:0:14797:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6fcda0ab-5b57-4e8f-beca-401d3c9668a1/ffff9ac682863800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783969564.166395:0:14797:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1783969564.166538:0:14797:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783969564.166593:0:14797:0:(import.c:65:import_set_state_nolock()) ffff9ac7c1984800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783969564.166628:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+6:2347:x1870627272238848:12345-192.168.203.39@tcp:8:mount.lustre.0 Request processed in 304us (12643us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969564.166642:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:2.0:1783969564.261233:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1870627280618368:0@lo:400:kworker.0 00000100:00100000:2.0:1783969564.261302:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969564.261363:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783969564.261369:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c75a22f-689e-4536-9c19-8125b0e8c51a:3285:1870627280617984:0@lo:400:kworker.0 00000100:00100000:2.0:1783969564.261399:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969564.261421:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280618496:0@lo:400:kworker.0 00000100:00100000:2.0:1783969564.261443:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969564.261499:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280618112:0@lo:400:kworker.0 00000100:00100000:2.0:1783969564.261528:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969564.261546:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1870627280618624:0@lo:400:kworker.0 00000100:00100000:2.0:1783969564.261587:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969564.261606:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783969564.261611:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1be8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280618240:0@lo:400:kworker.0 00000100:00100000:2.0:1783969564.261632:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969564.261661:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280618368 00000100:00100000:2.0:1783969564.261667:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280618368 00000100:00100000:2.0:1783969564.261708:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280618496 00000100:00100000:2.0:1783969564.261711:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280618496 00000100:00100000:2.0:1783969564.261733:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280618624 00000100:00100000:2.0:1783969564.261736:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280618624 00000100:00100000:2.0:1783969564.261752:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783969564.261759:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1870627280618368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969564.261808:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1870627280618368:12345-0@lo:400:kworker.0 Request processed in 49us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969564.261815:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783969564.261831:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783969564.261837:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280618496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969564.261897:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280618496:12345-0@lo:400:kworker.0 Request processed in 60us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969564.261904:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783969564.261916:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783969564.261922:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1870627280618624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969564.261953:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1870627280618624:12345-0@lo:400:kworker.0 Request processed in 31us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969564.261969:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783969564.261987:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280617984 00000100:00100000:2.0:1783969564.261990:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280617984 00000100:00100000:2.0:1783969564.262014:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783969564.262021:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7883c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:3285:x1870627280617984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969564.262051:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7883c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:3285:x1870627280617984:12345-0@lo:400:kworker.0 Request processed in 30us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969564.262057:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783969564.262088:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280618112 00000100:00100000:2.0:1783969564.262091:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280618112 00000100:00100000:2.0:1783969564.262115:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280618240 00000100:00100000:2.0:1783969564.262118:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280618240 00000100:00100000:2.0:1783969564.262133:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783969564.262138:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280618112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969564.262179:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280618112:12345-0@lo:400:kworker.0 Request processed in 41us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969564.262186:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783969564.262197:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783969564.262203:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3287:x1870627280618240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969564.262227:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3287:x1870627280618240:12345-0@lo:400:kworker.0 Request processed in 25us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969564.262233:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1783969564.262256:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783969564.262261:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969564.262290:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1be8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280618240:0@lo:400:kworker.0 00000100:00100000:2.0:1783969564.262300:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1be9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280618112:0@lo:400:kworker.0 00010000:00080000:2.0:1783969564.262319:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7bff3b100 x1870627280618624/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969564.262328:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1870627280618624:0@lo:400:kworker.0 00000100:00100000:2.0:1783969564.262364:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1beaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c75a22f-689e-4536-9c19-8125b0e8c51a:3285:1870627280617984:0@lo:400:kworker.0 00010000:00080000:2.0:1783969564.262374:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7bff38a80 x1870627280618496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969564.262383:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280618496:0@lo:400:kworker.0 00010000:00080000:2.0:1783969564.262392:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ac7bff39500 x1870627280618368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783969580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783969564.262401:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1870627280618368:0@lo:400:kworker.0 00000100:00100000:0.0:1783969564.263156:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac785317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280618752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969564.263206:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969564.263284:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280618752 00000100:00100000:3.0:1783969564.263290:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280618752 00000100:00100000:3.0:1783969564.263330:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783969564.263338:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1870627280618752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783969564.263355:0:14801:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783969564.263397:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1870627280618752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969564.263403:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783969564.263434:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac785317b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280618752:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1783969564.388171:0:7494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6fcda0ab-5b57-4e8f-beca-401d3c9668a1 00000001:00080000:1.0:1783969564.388187:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:0.0:1783969564.413356:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969564.413726:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272239104 00000100:00100000:2.0:1783969564.413736:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272239104 00000100:00100000:2.0:1783969564.413800:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:2.0:1783969564.413812:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+6:13744:x1870627272239104:12345-192.168.203.39@tcp:101:mkdir.0 00010000:00010000:2.0:1783969564.413833:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969564.413898:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac114 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63524 expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969564.414172:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099200/0xbacf56d076fac11b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969564.414188:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099200/0xbacf56d076fac11b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969564.414203:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099200/0xbacf56d076fac11b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969564.414408:0:14163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783969564.414412:0:14163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1783969564.422534:0:14163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099200/0xbacf56d076fac11b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969564.422598:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac114 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63524 expref: 8 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969564.422636:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099200/0xbacf56d076fac11b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63524 expref: 7 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969564.422646:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac785336900) 00010000:00010000:3.0:1783969564.422649:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783969564.422652:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786099200, rc 0) 00000100:00100000:3.0:1783969564.422730:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+7:13744:x1870627272239104:12345-192.168.203.39@tcp:101:mkdir.0 Request processed in 8919us (9384us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969564.422739:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 8 00010000:00010000:1.0:1783969564.453271:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969565.477733:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783969566.501113:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969566.602334:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969566.607362:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272239232 00000100:00100000:0.0:1783969566.607379:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272239232 00000100:00100000:0.0:1783969566.607549:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:0.0:1783969566.607563:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+7:13796:x1870627272239232:12345-192.168.203.39@tcp:41:lfs.0 00000004:00000024:0.0:1783969566.607606:0:14162:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1783969566.608329:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+7:13796:x1870627272239232:12345-192.168.203.39@tcp:41:lfs.0 Request processed in 767us (6001us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969566.608339:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00080000:2.0:1783969566.608409:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969566.616536:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969566.616851:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272239360 00000100:00100000:3.0:1783969566.616889:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272239360 00000100:00100000:3.0:1783969566.616989:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:3.0:1783969566.617000:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+6:13796:x1870627272239360:12345-192.168.203.39@tcp:13:lfs.0 00002000:00000024:3.0:1783969566.617049:0:14801:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783969566.617154:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+6:13796:x1870627272239360:12345-192.168.203.39@tcp:13:lfs.0 Request processed in 133us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969566.617356:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:3.0:1783969566.622317:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969566.624834:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272239488 00000100:00100000:1.0:1783969566.624849:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272239488 00000100:00100000:1.0:1783969566.624944:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:1.0:1783969566.624955:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+5:13796:x1870627272239488:12345-192.168.203.39@tcp:13:lfs.0 00002000:00000024:1.0:1783969566.624993:0:14800:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783969566.625095:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+5:13796:x1870627272239488:12345-192.168.203.39@tcp:13:lfs.0 Request processed in 141us (2787us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969566.625103:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00080000:2.0:1783969566.630496:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783969566.630511:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969566.868328:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969566.868422:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272239616 00000100:00100000:0.0:1783969566.868440:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272239616 00000100:00100000:0.0:1783969566.868518:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 92 00000100:00100000:0.0:1783969566.868529:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7883c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bdf8e85-d598-4892-bfdb-3f724decfbe5+10:13828:x1870627272239616:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783969566.868547:0:14158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969566.868577:0:14158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac681129400/0xbacf56d076fac122 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6352b expref: -99 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969566.868609:0:14158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac681129400/0xbacf56d076fac122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6352b expref: 11 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969566.868621:0:14158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac681129400/0xbacf56d076fac122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6352b expref: 11 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969566.868631:0:14158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac681129400, rc 0) 00000100:00100000:0.0:1783969566.868715:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7883c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bdf8e85-d598-4892-bfdb-3f724decfbe5+11:13828:x1870627272239616:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 187us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969566.868722:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 92 00000100:00100000:0.0:1783969566.892237:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969566.892385:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272239744 00000100:00100000:3.0:1783969566.892396:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272239744 00000100:00100000:3.0:1783969566.892457:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 93 00000100:00100000:3.0:1783969566.892475:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7883c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+11:13828:x1870627272239744:12345-192.168.203.39@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783969566.893017:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7883c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+11:13828:x1870627272239744:12345-192.168.203.39@tcp:501:mount.lustre.0 Request processed in 548us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969566.893034:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 93 00000100:00100000:3.0:1783969566.897908:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969566.898074:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272239872 00000100:00100000:1.0:1783969566.898084:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272239872 00000100:00100000:1.0:1783969566.898162:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 94 00000100:00100000:1.0:1783969566.898173:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7883c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bdf8e85-d598-4892-bfdb-3f724decfbe5+11:13828:x1870627272239872:12345-192.168.203.39@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783969566.898394:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7883c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bdf8e85-d598-4892-bfdb-3f724decfbe5+11:13828:x1870627272239872:12345-192.168.203.39@tcp:503:mount.lustre.0 Request processed in 222us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969566.898402:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 94 00000001:00100000:2.0:1783969566.899773:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6fcda0ab-5b57-4e8f-beca-401d3c9668a1 00000100:00100000:1.0:1783969566.902809:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969566.902908:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272240000 00000100:00100000:0.0:1783969566.902918:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272240000 00000100:00100000:0.0:1783969566.902971:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 95 00000100:00100000:0.0:1783969566.902981:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7883c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bdf8e85-d598-4892-bfdb-3f724decfbe5+11:13835:x1870627272240000:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783969566.903389:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7883c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bdf8e85-d598-4892-bfdb-3f724decfbe5+11:13835:x1870627272240000:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 407us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969566.903400:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 95 00000100:00100000:0.0:1783969566.928609:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969566.928739:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272240128 00000100:00100000:3.0:1783969566.928750:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272240128 00000100:00100000:3.0:1783969566.928809:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 96 00000100:00100000:3.0:1783969566.928819:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7883c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+11:13835:x1870627272240128:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783969566.937181:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7883c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+11:13835:x1870627272240128:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 8354us (8737us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969566.937212:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 96 00000100:00100000:3.0:1783969566.947410:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969566.948002:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272240256 00000100:00100000:1.0:1783969566.948012:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272240256 00000100:00100000:1.0:1783969566.948084:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 97 00000100:00100000:1.0:1783969566.948096:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7883c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bdf8e85-d598-4892-bfdb-3f724decfbe5+11:13828:x1870627272240256:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783969566.948111:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969566.948141:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac683624a00/0xbacf56d076fac129 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63555 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969566.948170:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac683624a00/0xbacf56d076fac129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63555 expref: 12 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969566.948183:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac683624a00/0xbacf56d076fac129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63555 expref: 12 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969566.948192:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac683624a00, rc 0) 00000100:00100000:1.0:1783969566.948254:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7883c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bdf8e85-d598-4892-bfdb-3f724decfbe5+12:13828:x1870627272240256:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 160us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969566.948262:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 97 00000100:00100000:3.0:1783969566.955325:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969566.955600:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272240384 00000100:00100000:1.0:1783969566.955610:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272240384 00000100:00100000:1.0:1783969566.955669:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 98 00000100:00100000:1.0:1783969566.955680:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7883c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+12:13828:x1870627272240384:12345-192.168.203.39@tcp:256:mount.lustre.0 20000000:01000000:1.0:1783969566.955703:0:14157:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783969566.955725:0:14157:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783969566.955729:0:14157:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783969566.955732:0:14157:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783969566.955741:0:14157:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1783969566.965441:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7883c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+12:13828:x1870627272240384:12345-192.168.203.39@tcp:256:mount.lustre.0 Request processed in 9749us (10112us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969566.965472:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 98 00000100:00100000:3.0:1783969566.971427:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969566.971567:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272240512 00000100:00100000:0.0:1783969566.971577:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272240512 00000100:00100000:0.0:1783969566.971634:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 99 00000100:00100000:0.0:1783969566.971644:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bdf8e85-d598-4892-bfdb-3f724decfbe5+12:13828:x1870627272240512:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783969566.971664:0:14158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969566.971683:0:14158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac681128c00/0xbacf56d076fac130 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6355c expref: -99 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969566.971712:0:14158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac681128c00/0xbacf56d076fac130 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6355c expref: 13 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969566.971722:0:14158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac681128c00/0xbacf56d076fac130 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6355c expref: 13 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969566.971732:0:14158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac681128c00, rc 0) 00000100:00100000:0.0:1783969566.971809:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bdf8e85-d598-4892-bfdb-3f724decfbe5+13:13828:x1870627272240512:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 166us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969566.971817:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 99 00000100:00100000:3.0:1783969566.976980:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969566.977411:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272240640 00000100:00100000:1.0:1783969566.977421:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272240640 00000100:00100000:1.0:1783969566.977588:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 100 00000100:00100000:1.0:1783969566.977599:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+13:13828:x1870627272240640:12345-192.168.203.39@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783969566.977970:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+13:13828:x1870627272240640:12345-192.168.203.39@tcp:501:mount.lustre.0 Request processed in 372us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969566.977979:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 100 00000100:00100000:1.0:1783969566.987726:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969566.987816:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272240768 00000100:00100000:2.0:1783969566.987825:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272240768 00000100:00100000:2.0:1783969566.987901:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 101 00000100:00100000:2.0:1783969566.987911:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bdf8e85-d598-4892-bfdb-3f724decfbe5+13:13828:x1870627272240768:12345-192.168.203.39@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783969566.988136:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bdf8e85-d598-4892-bfdb-3f724decfbe5+13:13828:x1870627272240768:12345-192.168.203.39@tcp:503:mount.lustre.0 Request processed in 216us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969566.988153:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 101 00000100:00100000:3.0:1783969566.991014:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969566.991316:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272240896 00000100:00100000:1.0:1783969566.991326:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272240896 00000100:00100000:1.0:1783969566.991379:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 102 00000100:00100000:1.0:1783969566.991389:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+13:13838:x1870627272240896:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783969566.991632:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+13:13838:x1870627272240896:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 243us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969566.991640:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 102 00000100:00100000:3.0:1783969566.996971:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969566.997653:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272241024 00000100:00100000:0.0:1783969566.997663:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272241024 00000100:00100000:0.0:1783969566.997709:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 103 00000100:00100000:0.0:1783969566.997718:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bdf8e85-d598-4892-bfdb-3f724decfbe5+13:13838:x1870627272241024:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783969566.997997:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bdf8e85-d598-4892-bfdb-3f724decfbe5+13:13838:x1870627272241024:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 278us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969566.998005:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 103 00000100:00100000:3.0:1783969567.011666:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969567.012053:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272241152 00000100:00100000:0.0:1783969567.012062:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272241152 00000100:00100000:0.0:1783969567.012109:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:0.0:1783969567.012117:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2347:x1870627272241152:12345-192.168.203.39@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783969567.012161:0:14164:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 978405fc-0033-4402-91b7-b6ffa4f032e9@192.168.203.39@tcp t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:0.0:1783969567.012198:0:14164:0:(genops.c:1406:class_connect()) connect: client 978405fc-0033-4402-91b7-b6ffa4f032e9, cookie 0xbacf56d076fac137 00000004:00100000:0.0:1783969567.012228:0:14164:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:0.0:1783969567.012348:0:14164:0:(import.c:65:import_set_state_nolock()) ffff9ac79e3dd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783969567.012429:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:978405fc-0033-4402-91b7-b6ffa4f032e9+6:2347:x1870627272241152:12345-192.168.203.39@tcp:38:mount.lustre.0 Request processed in 311us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969567.012446:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:3.0:1783969567.024478:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969567.024520:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969567.026420:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272241408 00000100:00100000:1.0:1783969567.026444:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272241408 00000100:00100000:1.0:1783969567.026531:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272241280 00000100:00100000:1.0:1783969567.026534:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272241280 00000100:00100000:1.0:1783969567.026559:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:1.0:1783969567.026568:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:978405fc-0033-4402-91b7-b6ffa4f032e9+7:13828:x1870627272241408:12345-192.168.203.39@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783969567.026610:0:14821:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1783969567.026692:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:978405fc-0033-4402-91b7-b6ffa4f032e9+7:13828:x1870627272241408:12345-192.168.203.39@tcp:41:mount.lustre.0 Request processed in 124us (2222us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969567.026700:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:1.0:1783969567.026717:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00100000:1.0:1783969567.026723:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:978405fc-0033-4402-91b7-b6ffa4f032e9+6:0:x1870627272241280:12345-192.168.203.39@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783969567.026743:0:14821:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1783969567.026767:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:978405fc-0033-4402-91b7-b6ffa4f032e9+6:0:x1870627272241280:12345-192.168.203.39@tcp:41:mount.lustre.0 Request processed in 44us (2245us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969567.026774:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00080000:2.0:1783969567.026896:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783969567.031805:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969567.031977:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272241536 00000100:00100000:2.0:1783969567.031986:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272241536 00000100:00100000:2.0:1783969567.032049:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:2.0:1783969567.032059:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:978405fc-0033-4402-91b7-b6ffa4f032e9+6:13828:x1870627272241536:12345-192.168.203.39@tcp:40:mount.lustre.0 00000100:00100000:2.0:1783969567.032164:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:978405fc-0033-4402-91b7-b6ffa4f032e9+6:13828:x1870627272241536:12345-192.168.203.39@tcp:40:mount.lustre.0 Request processed in 106us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969567.032173:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:3.0:1783969567.041833:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969567.041920:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969567.041957:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969567.042036:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272241664 00000100:00100000:2.0:1783969567.042047:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272241664 00000100:00100000:2.0:1783969567.042102:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272241792 00000100:00100000:2.0:1783969567.042105:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272241792 00000100:00100000:2.0:1783969567.042146:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:2.0:1783969567.042154:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1870627272241664:12345-192.168.203.39@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783969567.042183:0:14798:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 978405fc-0033-4402-91b7-b6ffa4f032e9@192.168.203.39@tcp t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:2.0:1783969567.042211:0:14798:0:(genops.c:1406:class_connect()) connect: client 978405fc-0033-4402-91b7-b6ffa4f032e9, cookie 0xbacf56d076fac13e 00002000:00100000:2.0:1783969567.042222:0:14798:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 978405fc-0033-4402-91b7-b6ffa4f032e9/ffff9ac7a70ec000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783969567.042233:0:14798:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:2.0:1783969567.042470:0:14798:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783969567.042501:0:14798:0:(import.c:65:import_set_state_nolock()) ffff9ac7a70e8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783969567.042578:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:978405fc-0033-4402-91b7-b6ffa4f032e9+6:2347:x1870627272241664:12345-192.168.203.39@tcp:8:mount.lustre.0 Request processed in 423us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969567.042586:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:2.0:1783969567.042603:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:2.0:1783969567.042609:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2347:x1870627272241792:12345-192.168.203.39@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783969567.042624:0:14798:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 978405fc-0033-4402-91b7-b6ffa4f032e9@192.168.203.39@tcp t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:2.0:1783969567.042642:0:14798:0:(genops.c:1406:class_connect()) connect: client 978405fc-0033-4402-91b7-b6ffa4f032e9, cookie 0xbacf56d076fac145 00002000:00100000:2.0:1783969567.042648:0:14798:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 978405fc-0033-4402-91b7-b6ffa4f032e9/ffff9ac7a70ee000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783969567.042654:0:14798:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00000100:00100000:0.0:1783969567.043206:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272241920 00000100:00100000:0.0:1783969567.043215:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272241920 00000100:00100000:0.0:1783969567.043257:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1 00000100:00100000:0.0:1783969567.043268:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:978405fc-0033-4402-91b7-b6ffa4f032e9+6:13828:x1870627272241920:12345-192.168.203.39@tcp:33:mount.lustre.0 00000004:00200000:0.0:1783969567.043487:0:14166:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1783969567.043649:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:978405fc-0033-4402-91b7-b6ffa4f032e9+6:13828:x1870627272241920:12345-192.168.203.39@tcp:33:mount.lustre.0 Request processed in 383us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969567.043657:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1 00002000:00080000:2.0:1783969567.043898:0:14798:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783969567.043920:0:14798:0:(import.c:65:import_set_state_nolock()) ffff9ac7bfc30800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783969567.043952:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:978405fc-0033-4402-91b7-b6ffa4f032e9+6:2347:x1870627272241792:12345-192.168.203.39@tcp:8:mount.lustre.0 Request processed in 1341us (1994us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969567.043959:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:3.0:1783969567.275591:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969567.275803:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272242048 00000100:00100000:0.0:1783969567.275813:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272242048 00000100:00100000:0.0:1783969567.275898:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 14 00000100:00100000:0.0:1783969567.275909:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:978405fc-0033-4402-91b7-b6ffa4f032e9+6:13859:x1870627272242048:12345-192.168.203.39@tcp:101:mkdir.0 00010000:00010000:0.0:1783969567.275929:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969567.275954:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128a00/0xbacf56d076fac14c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63586 expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969567.276022:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129200/0xbacf56d076fac153 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969567.276035:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129200/0xbacf56d076fac153 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969567.276049:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129200/0xbacf56d076fac153 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969567.276259:0:14163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783969567.276264:0:14163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1783969567.276346:0:14163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129200/0xbacf56d076fac153 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969567.276374:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128a00/0xbacf56d076fac14c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63586 expref: 8 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969567.276406:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129200/0xbacf56d076fac153 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63586 expref: 7 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969567.276415:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac785336900) 00010000:00010000:0.0:1783969567.276418:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783969567.276421:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac681129200, rc 0) 00000100:00100000:0.0:1783969567.276971:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:978405fc-0033-4402-91b7-b6ffa4f032e9+7:13859:x1870627272242048:12345-192.168.203.39@tcp:101:mkdir.0 Request processed in 1063us (1396us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969567.276980:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 14 00010000:00010000:1.0:1783969567.525705:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969568.357063:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280618880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969568.357430:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969568.357575:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280618880 00000100:00100000:0.0:1783969568.357583:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280618880 00000100:00100000:0.0:1783969568.357643:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783969568.357653:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280618880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783969568.357685:0:14800:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783969568.357743:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3285:x1870627280618880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969568.357751:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1783969568.357800:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969568.357815:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3285:1870627280618880:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783969568.551182:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969569.381633:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280619008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969569.381702:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969569.381773:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280619008 00000100:00100000:1.0:1783969569.381782:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280619008 00000100:00100000:1.0:1783969569.381835:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783969569.381843:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280619008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783969569.381891:0:14801:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783969569.381935:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280619008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969569.381941:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1783969569.381960:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969569.381986:0:3286:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1783969569.382006:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280619008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969569.384363:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1870627280619392:0@lo:400:kworker.0 00000100:00100000:1.0:1783969569.384487:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969569.384520:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783969569.384526:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280619520:0@lo:400:kworker.0 00000100:00100000:1.0:1783969569.384550:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969569.384707:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280619392 00000100:00100000:0.0:1783969569.384715:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280619392 00000100:00100000:0.0:1783969569.384752:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280619520 00000100:00100000:0.0:1783969569.384755:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280619520 00000100:00100000:0.0:1783969569.384779:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783969569.384787:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1870627280619392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969569.384836:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786092a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1870627280619392:12345-0@lo:400:kworker.0 Request processed in 50us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969569.384843:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783969569.384896:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783969569.384902:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280619520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969569.384933:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786091c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1870627280619520:12345-0@lo:400:kworker.0 Request processed in 31us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969569.384939:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1783969569.384960:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969569.384985:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3285:1870627280619520:0@lo:400:kworker.0 00000100:00100000:0.0:1783969569.384994:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3285:1870627280619392:0@lo:400:kworker.0 00000100:00100000:3.0:1783969569.386556:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c75a22f-689e-4536-9c19-8125b0e8c51a:3287:1870627280619136:0@lo:400:kworker.0 00000100:00100000:3.0:1783969569.386624:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969569.386668:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac786090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1870627280619648:0@lo:400:kworker.0 00000100:00100000:3.0:1783969569.386700:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969569.386723:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969569.386729:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280619264:0@lo:400:kworker.0 00000100:00100000:3.0:1783969569.386752:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969569.388078:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280619648 00000100:00100000:0.0:1783969569.388089:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280619648 00000100:00100000:0.0:1783969569.388161:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783969569.391308:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280619136 00000100:00100000:1.0:1783969569.391323:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280619136 00000100:00100000:1.0:1783969569.391386:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783969569.391396:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:3287:x1870627280619136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969569.391733:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:3287:x1870627280619136:12345-0@lo:400:kworker.0 Request processed in 337us (5107us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969569.391740:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783969569.391775:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280619264 00000100:00100000:1.0:1783969569.391778:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280619264 00000100:00100000:1.0:1783969569.391806:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783969569.391814:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280619264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969569.391848:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280619264:12345-0@lo:400:kworker.0 Request processed in 34us (5094us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969569.391855:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783969569.391930:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280619264:0@lo:400:kworker.0 00000100:00100000:1.0:1783969569.391944:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5c75a22f-689e-4536-9c19-8125b0e8c51a:3287:1870627280619136:0@lo:400:kworker.0 00000100:00080000:1.0:1783969569.391995:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969569.392210:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1870627280619648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969569.392262:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1870627280619648:12345-0@lo:400:kworker.0 Request processed in 59us (5561us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969569.392270:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783969569.404074:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac786090e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3287:1870627280619648:0@lo:400:kworker.0 00000001:00100000:2.0:1783969569.460328:0:7494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 978405fc-0033-4402-91b7-b6ffa4f032e9 00000001:00100000:0.0:1783969569.505730:0:5816:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 978405fc-0033-4402-91b7-b6ffa4f032e9 00000001:00100000:0.0:1783969569.505746:0:5816:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6fcda0ab-5b57-4e8f-beca-401d3c9668a1 00010000:00010000:1.0:1783969569.575313:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783969570.271316:0:16030:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1783969570.598976:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783969571.048031:0:14197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783969571.621498:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783969572.016087:0:6622:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 978405fc-0033-4402-91b7-b6ffa4f032e9 00000100:00100000:3.0:1783969572.405080:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969572.405136:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969572.405167:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969572.405192:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969572.405211:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969572.405228:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969572.405246:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969572.405268:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272242560 00000100:00100000:3.0:1783969572.405292:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272242560 00000100:00100000:3.0:1783969572.405344:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272242432 00000100:00100000:3.0:1783969572.405348:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272242432 00000100:00100000:3.0:1783969572.405362:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272242816 00000100:00100000:3.0:1783969572.405365:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272242816 00000100:00100000:3.0:1783969572.405375:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272242944 00000100:00100000:3.0:1783969572.405378:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272242944 00000100:00100000:3.0:1783969572.405393:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:3.0:1783969572.405608:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+5:2348:x1870627272242560:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969572.405679:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+5:2348:x1870627272242560:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 75us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969572.405687:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:3.0:1783969572.405704:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:3.0:1783969572.405711:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+5:2349:x1870627272242432:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969572.405752:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+5:2349:x1870627272242432:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 42us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969572.405759:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:3.0:1783969572.405773:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:3.0:1783969572.405781:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:978405fc-0033-4402-91b7-b6ffa4f032e9+5:2348:x1870627272242816:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969572.405802:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272242304 00000100:00100000:3.0:1783969572.405808:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:978405fc-0033-4402-91b7-b6ffa4f032e9+5:2348:x1870627272242816:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 27us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969572.405809:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272242304 00000100:00100000:3.0:1783969572.405818:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:3.0:1783969572.405834:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:3.0:1783969572.405842:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:978405fc-0033-4402-91b7-b6ffa4f032e9+5:2349:x1870627272242944:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783969572.405901:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272242176 00000100:00100000:2.0:1783969572.405906:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272242176 00000100:00100000:2.0:1783969572.405938:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 105 00000100:00100000:2.0:1783969572.405946:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+13:2349:x1870627272242176:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783969572.405977:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+13:2349:x1870627272242176:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 32us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969572.405984:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 105 00000100:00100000:3.0:1783969572.406463:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:978405fc-0033-4402-91b7-b6ffa4f032e9+5:2349:x1870627272242944:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 557us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969572.406471:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00080000:3.0:1783969572.406504:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783969572.406509:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783969572.406511:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783969572.417314:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272242688 00000100:00100000:2.0:1783969572.417328:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272242688 00000100:00100000:2.0:1783969572.418407:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:2.0:1783969572.418427:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+6:2348:x1870627272242304:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783969572.418508:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+6:2348:x1870627272242304:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 90us (13439us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969572.418517:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00080000:2.0:1783969572.419955:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783969572.420011:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:2.0:1783969572.420022:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:978405fc-0033-4402-91b7-b6ffa4f032e9+6:2349:x1870627272242688:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1783969572.420086:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:978405fc-0033-4402-91b7-b6ffa4f032e9+6:2349:x1870627272242688:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 66us (14856us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969572.420106:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 20 00010000:00010000:3.0:1783969572.645856:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969573.477047:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969573.477069:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7b57d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280619776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969573.477156:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969573.477219:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280619776 00000100:00100000:0.0:1783969573.477230:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280619776 00000100:00100000:0.0:1783969573.477304:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783969573.477315:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280619776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783969573.477350:0:14801:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783969573.477409:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280619776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969573.477416:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1783969573.477480:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783969573.477517:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7b57d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280619776:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1783969573.513075:0:16179:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe98cd6190 20000000:00000080:1.0:1783969573.513110:0:16179:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ac682686000 uarg=0000000000000000 20000000:01000000:1.0:1783969573.513149:0:16179:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783969573.513155:0:16179:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783969573.513159:0:16179:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1783969573.521297:0:16180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1783969573.521567:0:16179:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1783969573.535346:0:16179:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783969573.535925:0:16179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ac786098800/0xbacf56d076fac15a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969573.535946:0:16179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac7bfb92800/0xbacf56d076fabe51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fabe4a expref: 18 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969573.535974:0:16179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac7bfb93200/0xbacf56d076fabe9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fabe97 expref: 18 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969573.535981:0:16179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac7bfb93e00/0xbacf56d076fabfd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fabfcb expref: 18 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969573.535992:0:16179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac786099600/0xbacf56d076fac0f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb634fa expref: 12 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969573.536000:0:16179:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ac681128c00/0xbacf56d076fac130 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6355c expref: 12 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969573.536007:0:16179:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ac786098800/0xbacf56d076fac15a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969573.536051:0:16179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac681128c00/0xbacf56d076fac130 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6355c expref: 12 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969573.536066:0:16179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac681128c00/0xbacf56d076fac130 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6355c expref: 12 pid: 14158 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969573.536081:0:16179:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff38a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16179:1870627280619904:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969573.536195:0:16179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac786099600/0xbacf56d076fac0f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb634fa expref: 12 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969573.536204:0:16179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac786099600/0xbacf56d076fac0f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb634fa expref: 12 pid: 14155 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969573.536213:0:16179:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff3b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16179:1870627280620032:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969573.536268:0:16179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac7bfb93e00/0xbacf56d076fabfd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076fabfcb expref: 18 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969573.536276:0:16179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac7bfb93e00/0xbacf56d076fabfd2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076fabfcb expref: 18 pid: 14158 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969573.536287:0:16179:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff39f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16179:1870627280620160:0@lo:104: 00000100:00100000:2.0:1783969573.536341:0:16179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783969573.536367:0:16179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac7bfb93200/0xbacf56d076fabe9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076fabe97 expref: 18 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969573.536374:0:16179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac7bfb93200/0xbacf56d076fabe9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076fabe97 expref: 18 pid: 14158 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969573.536383:0:16179:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff39880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16179:1870627280620288:0@lo:104: 00000100:00100000:2.0:1783969573.536403:0:16179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783969573.536432:0:16179:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ac7bfb92800/0xbacf56d076fabe51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbacf56d076fabe4a expref: 18 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969573.536439:0:16179:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ac7bfb92800/0xbacf56d076fabe51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbacf56d076fabe4a expref: 18 pid: 14155 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969573.536447:0:16179:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff3a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16179:1870627280620416:0@lo:104: 00000100:00100000:2.0:1783969573.536470:0:16179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969573.536480:0:16179:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7bf56e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969573.536588:0:14146:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783969573.536602:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280620160 00000100:00100000:3.0:1783969573.536608:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280620160 00000100:00100000:3.0:1783969573.536676:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280620288 00000100:00100000:3.0:1783969573.536680:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280620288 00000100:00100000:3.0:1783969573.536692:0:14146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280620416 00000100:00100000:3.0:1783969573.536694:0:14146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280620416 00000100:00100000:3.0:1783969573.536705:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783969573.536713:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c75a22f-689e-4536-9c19-8125b0e8c51a+5:16179:x1870627280620160:12345-0@lo:104: 00010000:00010000:3.0:1783969573.536725:0:14146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac786098600/0xbacf56d076fabfcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076fabfd2 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.536794:0:14146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783969573.536800:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c75a22f-689e-4536-9c19-8125b0e8c51a+5:16179:x1870627280620160:12345-0@lo:104: Request processed in 88us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969573.536807:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783969573.536825:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783969573.536831:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c75a22f-689e-4536-9c19-8125b0e8c51a+4:16179:x1870627280620288:12345-0@lo:104: 00010000:00010000:3.0:1783969573.536840:0:14146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93400/0xbacf56d076fabe97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076fabe9e expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.536899:0:14146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783969573.536904:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c75a22f-689e-4536-9c19-8125b0e8c51a+4:16179:x1870627280620288:12345-0@lo:104: Request processed in 73us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969573.536910:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783969573.536922:0:14146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783969573.536928:0:14146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c167b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c75a22f-689e-4536-9c19-8125b0e8c51a+3:16179:x1870627280620416:12345-0@lo:104: 00010000:00010000:3.0:1783969573.536935:0:14146:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e000/0xbacf56d076fabe4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076fabe51 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.536961:0:14146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783969573.536972:0:14146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c167b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5c75a22f-689e-4536-9c19-8125b0e8c51a+3:16179:x1870627280620416:12345-0@lo:104: Request processed in 44us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969573.536978:0:14146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1783969573.537021:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783969573.537027:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac786098600/0xbacf56d076fabfcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076fabfd2 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.537035:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786098600 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:3.0:1783969573.537039:0:14152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac786098600/0xbacf56d076fabfcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076fabfd2 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.537048:0:14152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac786098600/0xbacf56d076fabfcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076fabfd2 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969573.537055:0:14152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac786098600/0xbacf56d076fabfcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076fabfd2 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969573.537061:0:14152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783969573.537101:0:14152:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac786098600/0xbacf56d076fabfcb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076fabfd2 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.537108:0:14152:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969573.537128:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac786098600/0xbacf56d076fabfcb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076fabfd2 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.537135:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac786098600/0xbacf56d076fabfcb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076fabfd2 expref: -99 pid: 15465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.537147:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783969573.537150:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93400/0xbacf56d076fabe97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076fabe9e expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.537166:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bfb93400 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:3.0:1783969573.537169:0:14152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93400/0xbacf56d076fabe97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076fabe9e expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.537176:0:14152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93400/0xbacf56d076fabe97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076fabe9e expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969573.537182:0:14152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93400/0xbacf56d076fabe97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076fabe9e expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969573.537186:0:14152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783969573.537200:0:14152:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93400/0xbacf56d076fabe97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076fabe9e expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.537206:0:14152:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969573.537213:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93400/0xbacf56d076fabe97 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076fabe9e expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.537219:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac7bfb93400/0xbacf56d076fabe97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076fabe9e expref: -99 pid: 14795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.537227:0:14152:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969573.537230:0:14152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e000/0xbacf56d076fabe4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbacf56d076fabe51 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.537235:0:14152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac7bf60e000 already unused, calling callback (ffffffffc1a6bc20) 10000000:00010000:3.0:1783969573.537238:0:14152:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e000/0xbacf56d076fabe4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbacf56d076fabe51 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.537256:0:14152:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e000/0xbacf56d076fabe4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbacf56d076fabe51 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783969573.537263:0:14152:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e000/0xbacf56d076fabe4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbacf56d076fabe51 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783969573.537268:0:14152:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783969573.537279:0:14152:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e000/0xbacf56d076fabe4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076fabe51 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.537285:0:14152:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783969573.537299:0:14152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e000/0xbacf56d076fabe4a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076fabe51 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.537306:0:14152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff9ac7bf60e000/0xbacf56d076fabe4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbacf56d076fabe51 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.537317:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969573.537318:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969573.537320:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969573.537338:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7b57d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c75a22f-689e-4536-9c19-8125b0e8c51a:3285:1870627280620544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969573.537367:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969573.537389:0:3285:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783969573.537402:0:3285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7b57d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c75a22f-689e-4536-9c19-8125b0e8c51a:3285:1870627280620672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969573.537422:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969573.537444:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783969573.537451:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7b57d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c75a22f-689e-4536-9c19-8125b0e8c51a:3288:1870627280620800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969573.537475:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969573.537508:0:14149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280620544 00000100:00100000:3.0:1783969573.537513:0:14149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280620544 00010000:00010000:3.0:1783969573.537532:0:14149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac7bfb93e00/0xbacf56d076fabfd2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076fabfcb expref: 19 pid: 14158 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969573.537546:0:14149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280620672 00000100:00100000:3.0:1783969573.537549:0:14149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280620672 00010000:00010000:3.0:1783969573.537558:0:14149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac7bfb93200/0xbacf56d076fabe9e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076fabe97 expref: 20 pid: 14158 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969573.537568:0:14149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280620800 00000100:00100000:3.0:1783969573.537570:0:14149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280620800 00010000:00010000:3.0:1783969573.537579:0:14149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac7bfb92800/0xbacf56d076fabe51 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076fabe4a expref: 21 pid: 14155 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969573.537590:0:14149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783969573.537596:0:14149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c75a22f-689e-4536-9c19-8125b0e8c51a+21:3285:x1870627280620544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969573.537604:0:14149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969573.537609:0:14149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac7bfb93e00/0xbacf56d076fabfd2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076fabfcb expref: 21 pid: 14158 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.537618:0:14149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac7bfb93e00/0xbacf56d076fabfd2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076fabfcb expref: 21 pid: 14158 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.537633:0:14149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969573.537659:0:14149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c75a22f-689e-4536-9c19-8125b0e8c51a+21:3285:x1870627280620544:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969573.537665:0:14149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783969573.537680:0:14149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783969573.537687:0:14149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c75a22f-689e-4536-9c19-8125b0e8c51a+20:3285:x1870627280620672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969573.537704:0:14149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969573.537708:0:14149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac7bfb93200/0xbacf56d076fabe9e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076fabe97 expref: 20 pid: 14158 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.537720:0:14149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac7bfb93200/0xbacf56d076fabe9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076fabe97 expref: 20 pid: 14158 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969573.537720:0:16179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7bfb93e00/0xbacf56d076fabfd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076fabfcb expref: 20 pid: 14158 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.537742:0:14149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969573.537743:0:16179:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff39f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16179:1870627280620160:0@lo:104: 00010000:00010000:2.0:1783969573.537756:0:16179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7bfb93200/0xbacf56d076fabe9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076fabe97 expref: 19 pid: 14158 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969573.537773:0:14149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c75a22f-689e-4536-9c19-8125b0e8c51a+18:3285:x1870627280620672:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969573.537775:0:16179:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff39880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16179:1870627280620288:0@lo:104: 00000100:00100000:3.0:1783969573.537788:0:14149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783969573.537796:0:16179:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff3a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16179:1870627280620416:0@lo:104: 00000100:00100000:3.0:1783969573.537807:0:14149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783969573.537815:0:14149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac791057850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c75a22f-689e-4536-9c19-8125b0e8c51a+17:3288:x1870627280620800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783969573.537823:0:14149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969573.537827:0:14149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac7bfb92800/0xbacf56d076fabe51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbacf56d076fabe4a expref: 17 pid: 14155 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.537835:0:14149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac7bfb92800/0xbacf56d076fabe51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbacf56d076fabe4a expref: 17 pid: 14155 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.537844:0:14149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac7bfb92800/0xbacf56d076fabe51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbacf56d076fabe4a expref: 17 pid: 14155 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.537853:0:14149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969573.537900:0:14149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac791057850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:3288:x1870627280620800:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969573.537906:0:14149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783969573.537953:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7b57d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c75a22f-689e-4536-9c19-8125b0e8c51a:3285:1870627280620672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783969573.537974:0:3285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7b57d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5c75a22f-689e-4536-9c19-8125b0e8c51a:3285:1870627280620544:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783969573.538207:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783969573.539428:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7b57d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5c75a22f-689e-4536-9c19-8125b0e8c51a:3288:1870627280620800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783969573.544347:0:16179:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff38a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16179:1870627280619904:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783969573.544363:0:16179:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff3b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16179:1870627280620032:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969573.544399:0:16179:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ac786098800/0xbacf56d076fac15a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969573.547020:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969573.547106:0:14149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272243072 00000100:00100000:2.0:1783969573.547109:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969573.547126:0:14149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272243072 00010000:00010000:3.0:1783969573.547171:0:14149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac681128c00/0xbacf56d076fac130 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6355c expref: 13 pid: 14158 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969573.547207:0:14149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272243200 00000100:00100000:3.0:1783969573.547209:0:14149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272243200 00010000:00010000:3.0:1783969573.547221:0:14149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ac786099600/0xbacf56d076fac0f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb634fa expref: 14 pid: 14155 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969573.547235:0:14149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:3.0:1783969573.547243:0:14149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+14:2351:x1870627272243072:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969573.547256:0:14149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969573.547263:0:14149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac681128c00/0xbacf56d076fac130 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6355c expref: 14 pid: 14158 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969573.547265:0:14148:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783969573.547277:0:14148:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1783969573.547280:0:14149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac681128c00/0xbacf56d076fac130 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6355c expref: 14 pid: 14158 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.547298:0:14149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac681128c00/0xbacf56d076fac130 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6355c expref: 14 pid: 14158 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.547311:0:14149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969573.547368:0:14149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+13:2351:x1870627272243072:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 124us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969573.547375:0:14149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:3.0:1783969573.547391:0:14149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:3.0:1783969573.547417:0:14149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+12:2351:x1870627272243200:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969573.547424:0:14149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969573.547429:0:14149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ac786099600/0xbacf56d076fac0f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb634fa expref: 12 pid: 14155 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.547438:0:14149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ac786099600/0xbacf56d076fac0f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb634fa expref: 12 pid: 14155 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.547448:0:14149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac786099600/0xbacf56d076fac0f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb634fa expref: 12 pid: 14155 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.547460:0:14149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ac786098800/0xbacf56d076fac15a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.547468:0:14149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac786098800/0xbacf56d076fac15a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.547480:0:14149:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac786098800/0xbacf56d076fac15a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.547487:0:14149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ac786098800/0xbacf56d076fac15a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.547493:0:14149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ac786098800/0xbacf56d076fac15a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.547500:0:14149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ac786098800/0xbacf56d076fac15a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.547505:0:14149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786098800 already unused, calling callback (ffffffffc1485230) 00010000:00010000:3.0:1783969573.547508:0:14149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ac786098800/0xbacf56d076fac15a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.547522:0:14149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ac786098800/0xbacf56d076fac15a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.547532:0:14149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ac786098800/0xbacf56d076fac15a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969573.547541:0:14149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969573.547561:0:14149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+11:2351:x1870627272243200:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 145us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969573.547567:0:14149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 8 00010000:00010000:2.0:1783969573.547969:0:16179:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ac786098800/0xbacf56d076fac15a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969573.547979:0:16179:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ac786098800/0xbacf56d076fac15a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969573.547984:0:16179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ac786098800/0xbacf56d076fac15a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969573.670916:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969574.501351:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280620928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783969574.501424:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969574.501528:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280620928 00000100:00100000:0.0:1783969574.501537:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280620928 00000100:00100000:0.0:1783969574.501607:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783969574.501616:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280620928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783969574.501648:0:14801:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783969574.501688:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786090e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280620928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969574.501695:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1783969574.501801:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969574.501833:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280620928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783969574.502756:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7b57d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280621312:0@lo:400:kworker.0 00000100:00100000:3.0:1783969574.502805:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969574.502832:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783969574.502837:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7b57d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280621440:0@lo:400:kworker.0 00000100:00100000:3.0:1783969574.502853:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969574.502893:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7b57d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280621184:0@lo:400:kworker.0 00000100:00100000:3.0:1783969574.502914:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969574.502928:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783969574.502932:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7b57d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c75a22f-689e-4536-9c19-8125b0e8c51a:3286:1870627280621056:0@lo:400:kworker.0 00000100:00100000:3.0:1783969574.502953:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969574.503102:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7b57d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1870627280621568:0@lo:400:kworker.0 00000100:00100000:3.0:1783969574.503124:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969574.503158:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280621312 00000100:00100000:3.0:1783969574.503164:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280621312 00000100:00100000:3.0:1783969574.503196:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280621440 00000100:00100000:3.0:1783969574.503198:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280621440 00000100:00100000:3.0:1783969574.503228:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280621568 00000100:00100000:3.0:1783969574.503230:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280621568 00000100:00100000:3.0:1783969574.503243:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783969574.503249:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280621312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969574.503290:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1870627280621312:12345-0@lo:400:kworker.0 Request processed in 40us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969574.503296:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783969574.503309:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783969574.503314:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280621440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969574.503332:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1870627280621440:12345-0@lo:400:kworker.0 Request processed in 19us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969574.503338:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783969574.503346:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783969574.503350:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1870627280621568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969574.503376:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1870627280621568:12345-0@lo:400:kworker.0 Request processed in 25us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969574.503381:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783969574.503401:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280621184 00000100:00100000:3.0:1783969574.503404:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280621184 00000100:00100000:3.0:1783969574.503424:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783969574.503429:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac785314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280621184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969574.503455:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac785314000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280621184:12345-0@lo:400:kworker.0 Request processed in 25us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969574.503460:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783969574.503476:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280621056 00000100:00100000:3.0:1783969574.503479:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280621056 00000100:00100000:3.0:1783969574.503502:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783969574.503516:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:3286:x1870627280621056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969574.503546:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:3286:x1870627280621056:12345-0@lo:400:kworker.0 Request processed in 33us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969574.503552:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783969574.505358:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7b57d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3287:1870627280621440:0@lo:400:kworker.0 00000100:00100000:3.0:1783969574.505389:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7b57d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3287:1870627280621312:0@lo:400:kworker.0 00000100:00100000:3.0:1783969574.505427:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7b57d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c75a22f-689e-4536-9c19-8125b0e8c51a:3286:1870627280621056:0@lo:400:kworker.0 00000100:00100000:3.0:1783969574.505437:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7b57d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1870627280621568:0@lo:400:kworker.0 00000100:00100000:3.0:1783969574.505447:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7b57d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280621184:0@lo:400:kworker.0 00000100:00080000:3.0:1783969574.505499:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783969574.693182:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783969574.950921:0:14160:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783969574.950930:0:14160:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ac79e0fc000 from 10 10000000:01000000:3.0:1783969574.950935:0:14160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783969574.950978:0:14160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de6a00/0xbacf56d076fac161 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969574.950990:0:14160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac783de6a00/0xbacf56d076fac161 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969574.951001:0:14160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac783de6a00/0xbacf56d076fac161 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969574.951026:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff36680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280621696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783969574.951107:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969574.951162:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac788723cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969574.952705:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280621696 00000100:00100000:0.0:1783969574.952716:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280621696 00000100:00100000:0.0:1783969574.952903:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783969574.952916:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+16:14160:x1870627280621696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969574.952932:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969574.952950:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac681128600/0xbacf56d076fac168 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076fac161 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969574.952975:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac681128600/0xbacf56d076fac168 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076fac161 expref: 17 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969574.952986:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac681128600/0xbacf56d076fac168 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fac161 expref: 17 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969574.952995:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac681128600, rc 0) 00000100:00100000:0.0:1783969574.953058:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+17:14160:x1870627280621696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (1950us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969574.953072:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783969574.957008:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff36680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280621696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783969574.957042:0:14160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac783de6a00/0xbacf56d076fac161 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fac168 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969574.957055:0:14160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac783de6a00/0xbacf56d076fac161 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076fac168 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969574.957150:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac786092300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280621824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969574.957213:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969574.957257:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac799f73b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783969574.957282:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280621824 00000100:00100000:1.0:1783969574.957288:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280621824 00000100:00100000:1.0:1783969574.957336:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783969574.957346:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+17:14160:x1870627280621824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969574.957624:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+17:14160:x1870627280621824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 278us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969574.957641:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783969574.957676:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac786092300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280621824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969574.957704:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac786092300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280621952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969574.957742:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969574.957757:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac799f73b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783969574.957769:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280621952 00000100:00100000:1.0:1783969574.957773:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280621952 00000100:00100000:1.0:1783969574.957793:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783969574.957799:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+17:14160:x1870627280621952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969574.957954:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+17:14160:x1870627280621952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969574.957960:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783969574.957996:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac786092300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280621952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783969574.966507:0:16235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1783969574.966802:0:14160:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1783969574.966826:0:14160:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783969574.966837:0:14160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac783de6a00/0xbacf56d076fac161 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fac168 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969574.966849:0:14160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac783de6a00/0xbacf56d076fac161 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fac168 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783969574.966881:0:14160:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783969574.966884:0:14160:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ac786169000 from 10 10000000:01000000:0.0:1783969574.966887:0:14160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783969574.966925:0:14160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac681129000/0xbacf56d076fac16f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969574.966934:0:14160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac681129000/0xbacf56d076fac16f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969574.966944:0:14160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac681129000/0xbacf56d076fac16f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969574.966967:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280622080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783969574.967038:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969574.967095:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac798f95540 going to sleep for 11 seconds 00000100:00100000:2.0:1783969574.967154:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280622080 00000100:00100000:2.0:1783969574.967161:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280622080 00000100:00100000:2.0:1783969574.967210:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783969574.967219:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+17:14160:x1870627280622080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783969574.967232:0:14158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969574.967260:0:14158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac786098600/0xbacf56d076fac176 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076fac16f expref: -99 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969574.967283:0:14158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac786098600/0xbacf56d076fac176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076fac16f expref: 18 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969574.967294:0:14158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac786098600/0xbacf56d076fac176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fac16f expref: 18 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969574.967303:0:14158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786098600, rc 0) 00000100:00100000:2.0:1783969574.967344:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+18:14160:x1870627280622080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969574.967351:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783969574.968140:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280622080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969574.968161:0:14160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac681129000/0xbacf56d076fac16f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fac176 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969574.968173:0:14160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac681129000/0xbacf56d076fac16f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076fac176 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969574.968250:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280622208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969574.968286:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969574.968331:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac798f95540 going to sleep for 11 seconds 00000100:00100000:2.0:1783969574.968681:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280622208 00000100:00100000:2.0:1783969574.968687:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280622208 00000100:00100000:2.0:1783969574.968727:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783969574.968735:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+18:14160:x1870627280622208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783969574.969021:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5c75a22f-689e-4536-9c19-8125b0e8c51a+18:14160:x1870627280622208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 286us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969574.969029:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783969574.969204:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280622208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969574.969236:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280622336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783969574.969277:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969574.969307:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac798f95540 going to sleep for 11 seconds 00000100:00100000:1.0:1783969574.969365:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280622336 00000100:00100000:1.0:1783969574.969380:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280622336 00000100:00100000:1.0:1783969574.969413:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783969574.969420:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+18:14160:x1870627280622336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783969574.969714:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+18:14160:x1870627280622336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 294us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969574.969721:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783969574.969796:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280622336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783969574.972745:0:16236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1783969574.973299:0:14160:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1783969574.973331:0:14160:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783969574.973343:0:14160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac681129000/0xbacf56d076fac16f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fac176 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969574.973362:0:14160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac681129000/0xbacf56d076fac16f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fac176 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783969574.973385:0:14160:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783969574.973388:0:14160:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9ac7c1809000 from 10 10000000:01000000:1.0:1783969574.973391:0:14160:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783969574.973429:0:14160:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac683624600/0xbacf56d076fac17d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969574.973437:0:14160:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff9ac683624600/0xbacf56d076fac17d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969574.973448:0:14160:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff9ac683624600/0xbacf56d076fac17d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969574.973472:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac786092300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280622464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783969574.973534:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783969574.973700:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac799f73f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783969574.973812:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280622464 00000100:00100000:0.0:1783969574.973819:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280622464 00000100:00100000:0.0:1783969574.973918:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783969574.973928:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+18:14160:x1870627280622464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969574.973940:0:14158:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969574.973953:0:14158:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac681128400/0xbacf56d076fac184 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbacf56d076fac17d expref: -99 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969574.973976:0:14158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac681128400/0xbacf56d076fac184 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbacf56d076fac17d expref: 19 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969574.973987:0:14158:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac681128400/0xbacf56d076fac184 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbacf56d076fac17d expref: 19 pid: 14158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969574.973995:0:14158:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac681128400, rc 0) 00000100:00100000:0.0:1783969574.974037:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:14160:x1870627280622464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969574.974054:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1783969574.974113:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac786092300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280622464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969574.974127:0:14160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff9ac683624600/0xbacf56d076fac17d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fac184 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969574.974135:0:14160:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff9ac683624600/0xbacf56d076fac17d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbacf56d076fac184 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969574.974188:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280622592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969574.974214:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969574.974228:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac78a19c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969574.974240:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280622592 00000100:00100000:0.0:1783969574.974243:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280622592 00000100:00100000:0.0:1783969574.974261:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783969574.974268:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c04bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:14160:x1870627280622592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969574.975835:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c04bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:14160:x1870627280622592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1560us (1613us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969574.975847:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1783969574.975910:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280622592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783969574.975954:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf6b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280622720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783969574.975998:0:14160:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969574.976023:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac78a19c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969574.976035:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280622720 00000100:00100000:0.0:1783969574.976040:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280622720 00000100:00100000:0.0:1783969574.976065:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1783969574.976091:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:14160:x1870627280622720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783969574.976231:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:14160:x1870627280622720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969574.976237:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1783969574.976271:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf6b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5c75a22f-689e-4536-9c19-8125b0e8c51a:14160:1870627280622720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783969574.978025:0:16238:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1783969574.978100:0:14160:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1783969574.978117:0:14160:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783969574.978128:0:14160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff9ac683624600/0xbacf56d076fac17d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fac184 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969574.978138:0:14160:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff9ac683624600/0xbacf56d076fac17d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbacf56d076fac184 expref: -99 pid: 14160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969575.157123:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969575.157395:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272243328 00000100:00100000:0.0:1783969575.157413:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272243328 00000100:00100000:0.0:1783969575.157470:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 116 00000100:00100000:0.0:1783969575.157479:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+11:13714:x1870627272243328:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783969575.157495:0:14157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969575.157522:0:14157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac681128000/0xbacf56d076fac18b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6358d expref: -99 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969575.157549:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac681128000/0xbacf56d076fac18b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6358d expref: 12 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969575.157560:0:14157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac681128000/0xbacf56d076fac18b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6358d expref: 12 pid: 14157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969575.157586:0:14157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac681128000, rc 0) 00000100:00100000:0.0:1783969575.157649:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+12:13714:x1870627272243328:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 Request processed in 171us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969575.157656:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 116 00000100:00100000:2.0:1783969575.162200:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969575.162290:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272243456 00000100:00100000:1.0:1783969575.162301:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272243456 00000100:00100000:1.0:1783969575.162356:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 117 00000100:00100000:1.0:1783969575.162365:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bdf8e85-d598-4892-bfdb-3f724decfbe5+12:13714:x1870627272243456:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969575.162741:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bdf8e85-d598-4892-bfdb-3f724decfbe5+12:13714:x1870627272243456:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 Request processed in 375us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969575.162749:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 117 00000100:00100000:1.0:1783969575.164571:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969575.164638:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272243584 00000100:00100000:2.0:1783969575.164647:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272243584 00000100:00100000:2.0:1783969575.164699:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 118 00000100:00100000:2.0:1783969575.164709:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bdf8e85-d598-4892-bfdb-3f724decfbe5+12:13714:x1870627272243584:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969575.164939:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bdf8e85-d598-4892-bfdb-3f724decfbe5+12:13714:x1870627272243584:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 Request processed in 230us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969575.164947:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 118 00000100:00100000:3.0:1783969575.171750:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969575.172229:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272243712 00000100:00100000:1.0:1783969575.172240:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272243712 00000100:00100000:1.0:1783969575.172301:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 119 00000100:00100000:1.0:1783969575.172311:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bdf8e85-d598-4892-bfdb-3f724decfbe5+12:13714:x1870627272243712:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783969575.172327:0:14155:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969575.172347:0:14155:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ac683624e00/0xbacf56d076fac192 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63594 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969575.172376:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ac683624e00/0xbacf56d076fac192 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63594 expref: 13 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969575.172397:0:14155:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ac683624e00/0xbacf56d076fac192 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63594 expref: 13 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969575.172405:0:14155:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac683624e00, rc 0) 00000100:00100000:1.0:1783969575.172468:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2bdf8e85-d598-4892-bfdb-3f724decfbe5+13:13714:x1870627272243712:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 Request processed in 157us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969575.172475:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 119 00000100:00100000:3.0:1783969575.176399:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969575.177274:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272243840 00000100:00100000:0.0:1783969575.177285:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272243840 00000100:00100000:1.0:1783969575.177416:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 120 00000100:00100000:1.0:1783969575.177426:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+13:13714:x1870627272243840:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783969575.177829:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+13:13714:x1870627272243840:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 Request processed in 402us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969575.177838:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 120 00000100:00100000:3.0:1783969575.180191:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969575.180364:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272243968 00000100:00100000:2.0:1783969575.180372:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272243968 00000100:00100000:2.0:1783969575.180433:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 121 00000100:00100000:2.0:1783969575.180443:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bdf8e85-d598-4892-bfdb-3f724decfbe5+13:13714:x1870627272243968:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783969575.181148:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2bdf8e85-d598-4892-bfdb-3f724decfbe5+13:13714:x1870627272243968:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 Request processed in 704us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969575.181159:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 121 00010000:00010000:1.0:1783969575.718617:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783969576.741193:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969577.104022:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969577.104337:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272244096 00000100:00100000:2.0:1783969577.104346:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272244096 00000100:00100000:2.0:1783969577.104429:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00100000:2.0:1783969577.104446:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+6:14369:x1870627272244096:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783969577.104468:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969577.104488:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fac199 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6359b expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.104549:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac1a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.104562:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac1a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.104576:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac1a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.104590:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fac1a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.104597:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fac1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.104622:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fac1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783969577.104987:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783969577.106051:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098c00/0xbacf56d076fac1ae lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.106148:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098c00/0xbacf56d076fac1ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.106159:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098c00/0xbacf56d076fac1ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969577.106254:0:14163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1783969577.106258:0:14163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1783969577.106354:0:14163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098c00/0xbacf56d076fac1ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.106433:0:14163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac1a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.106441:0:14163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac1a0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.106449:0:14163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac1a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.106456:0:14163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786098400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969577.106460:0:14163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac1a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.106467:0:14163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac1a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.106488:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac785336900) 00010000:00010000:2.0:1783969577.106492:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969577.106497:0:14163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac1a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.106502:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac1a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.106514:0:14163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fac1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.106520:0:14163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fac1a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.106526:0:14163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fac1a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.106531:0:14163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786098e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969577.106602:0:14163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fac1a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.106610:0:14163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fac1a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.106619:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ac785336f00) 00010000:00010000:2.0:1783969577.106622:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969577.106625:0:14163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fac1a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.106630:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fac1a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.107187:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fac199 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6359b expref: 8 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.107204:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098c00/0xbacf56d076fac1ae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6359b expref: 7 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.107212:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ac785336100) 00010000:00010000:2.0:1783969577.107214:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783969577.107217:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786098c00, rc 0) 00000100:00100000:2.0:1783969577.107337:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+7:14369:x1870627272244096:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 2897us (3323us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969577.107346:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00100000:1.0:1783969577.112117:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969577.112387:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272244352 00000100:00100000:3.0:1783969577.112397:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272244352 00000100:00100000:3.0:1783969577.112457:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:3.0:1783969577.112468:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+7:14369:x1870627272244352:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969577.112487:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969577.112506:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac1b5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb635a2 expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.112576:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fac1bc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.112591:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fac1bc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.112603:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fac1bc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.112618:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fac1c3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.112626:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fac1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.112633:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fac1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.122398:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fac1ca lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.122419:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fac1ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.122431:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fac1ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969577.122443:0:14164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1783969577.122976:0:14164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fac1bc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.122986:0:14164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fac1bc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.122993:0:14164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fac1bc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.123000:0:14164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de7600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969577.123005:0:14164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fac1bc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.123088:0:14164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fac1bc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.123103:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ac785336100) 00010000:00010000:3.0:1783969577.123271:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969577.123278:0:14164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fac1bc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.123296:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fac1bc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.123311:0:14164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fac1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.123316:0:14164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fac1c3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.123322:0:14164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fac1c3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.123327:0:14164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6000 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969577.123330:0:14164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fac1c3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.123336:0:14164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fac1c3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.123345:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ac78c550100) 00010000:00010000:3.0:1783969577.123348:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969577.123350:0:14164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fac1c3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.123356:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fac1c3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.124120:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac1b5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635a2 expref: 10 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.124148:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7800/0xbacf56d076fac1ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635a2 expref: 9 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.124157:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac78c550a00) 00010000:00010000:3.0:1783969577.124159:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969577.124162:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de7800, rc 0) 00000100:00100000:3.0:1783969577.124598:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786091880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+9:14369:x1870627272244352:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 12130us (12494us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1783969577.124608:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:0.0:1783969577.130547:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969577.130637:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272244480 00000100:00100000:1.0:1783969577.130645:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272244480 00000100:00100000:1.0:1783969577.130729:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:1.0:1783969577.130739:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+9:14369:x1870627272244480:12345-192.168.203.39@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1783969577.130836:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+9:14369:x1870627272244480:12345-192.168.203.39@tcp:59:lhsmtool_posix.0 Request processed in 98us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969577.130845:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:1.0:1783969577.182830:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969577.183135:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272244608 00000100:00100000:2.0:1783969577.183146:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272244608 00000100:00100000:2.0:1783969577.183211:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:2.0:1783969577.183221:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+9:14375:x1870627272244608:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783969577.183241:0:14821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969577.183261:0:14821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fac1d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb635a9 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.183323:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fac1df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.183337:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fac1df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.183348:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fac1df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.183383:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac1e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.183392:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac1e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.183400:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac1e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.183644:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fac1df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.183717:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fac1df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.183724:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fac1df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.183730:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786098e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969577.183734:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fac1df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.183742:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fac1df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.183755:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac785336900) 00010000:00010000:2.0:1783969577.183758:0:14821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969577.183762:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fac1df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.183767:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fac1df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.183787:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac1e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.183793:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac1e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.183799:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac1e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.183803:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786098400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969577.183806:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac1e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.183812:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac1e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.183819:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ac785336f00) 00010000:00010000:2.0:1783969577.183821:0:14821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969577.183823:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac1e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.183828:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac1e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.184180:0:14821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fac1d8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635a9 expref: 10 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.184196:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac785336900) 00010000:00010000:2.0:1783969577.184198:0:14821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969577.184211:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fac1d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635a9 expref: 10 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.184222:0:14821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786098000, rc 0) 00000100:00100000:2.0:1783969577.184323:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786090000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+9:14375:x1870627272244608:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1103us (1500us total) trans 0 rc 301/301 00000100:00100000:2.0:1783969577.184331:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 18 00000040:00080000:0.0:1783969577.189673:0:14197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783969577.193149:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969577.193317:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272244736 00000100:00100000:1.0:1783969577.193326:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272244736 00000100:00100000:1.0:1783969577.193386:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:1.0:1783969577.193396:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+9:14375:x1870627272244736:12345-192.168.203.39@tcp:700:lfs.0 00000100:00100000:1.0:1783969577.193481:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+9:14375:x1870627272244736:12345-192.168.203.39@tcp:700:lfs.0 Request processed in 86us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969577.193490:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:3.0:1783969577.199347:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969577.199443:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272244992 00000100:00100000:1.0:1783969577.199452:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272244992 00000100:00100000:1.0:1783969577.199538:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:1.0:1783969577.199547:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+9:14375:x1870627272244992:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:1.0:1783969577.199597:0:14162:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783969577.199622:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099200/0xbacf56d076fac11b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63524 expref: 9 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.199641:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac785336900) 00010000:00010000:1.0:1783969577.199645:0:14162:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783969577.199965:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625800/0xbacf56d076fac1ed lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.199980:0:14162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129200/0xbacf56d076fac153 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63586 expref: 5 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.199997:0:14162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625800/0xbacf56d076fac1ed lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.201150:0:14162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129200/0xbacf56d076fac153 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63586 expref: 5 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.201170:0:14162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129200/0xbacf56d076fac153 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63586 expref: 5 pid: 14163 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969577.201185:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac786092d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14162:1870627280622848:192.168.203.39@tcp:104: 00000100:00100000:1.0:1783969577.201266:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac799f739c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969577.206407:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969577.206572:0:14149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272245120 00000100:00100000:0.0:1783969577.206581:0:14149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272245120 00000100:00100000:1.0:1783969577.206621:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac786092d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14162:1870627280622848:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783969577.206633:0:14149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129200/0xbacf56d076fac153 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63586 expref: 6 pid: 14163 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.206643:0:14162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625800/0xbacf56d076fac1ed lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783969577.206758:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783969577.206799:0:14149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:0.0:1783969577.206813:0:14149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:978405fc-0033-4402-91b7-b6ffa4f032e9+6:2351:x1870627272245120:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969577.206826:0:14149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969577.206833:0:14149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129200/0xbacf56d076fac153 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63586 expref: 6 pid: 14163 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.206846:0:14149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129200/0xbacf56d076fac153 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63586 expref: 6 pid: 14163 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.206899:0:14149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129200/0xbacf56d076fac153 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63586 expref: 6 pid: 14163 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.206933:0:14149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac785336900) 00010000:00010000:0.0:1783969577.206939:0:14149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625800/0xbacf56d076fac1ed lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.206948:0:14149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625800/0xbacf56d076fac1ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.206955:0:14149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625800/0xbacf56d076fac1ed lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.206974:0:14149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783969577.207029:0:14162:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625800/0xbacf56d076fac1ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.207036:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625800/0xbacf56d076fac1ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.207073:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625c00/0xbacf56d076fac1f4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.207084:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625c00/0xbacf56d076fac1f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.207092:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625c00/0xbacf56d076fac1f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969577.207099:0:14149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:978405fc-0033-4402-91b7-b6ffa4f032e9+5:2351:x1870627272245120:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 291us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969577.207108:0:14149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 9 00000004:00200000:1.0:1783969577.209254:0:14162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1783969577.209271:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625800/0xbacf56d076fac1ed lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.209281:0:14162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625800/0xbacf56d076fac1ed lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.209288:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625800/0xbacf56d076fac1ed lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.209294:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac683625800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969577.209299:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625800/0xbacf56d076fac1ed lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.209306:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625800/0xbacf56d076fac1ed lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.209320:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac785336900) 00010000:00010000:1.0:1783969577.209323:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969577.209327:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625800/0xbacf56d076fac1ed lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.209333:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625800/0xbacf56d076fac1ed lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783969577.209350:0:14162:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005e46b3b3 reply state 00000000b0ba2d8e transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625c00/0xbacf56d076fac1f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969577.209358:0:14162:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783969577.209508:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+10:14375:x1870627272244992:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 9958us (10167us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1783969577.209526:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 19 00010000:00010000:2.0:1783969577.215428:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625c00/0xbacf56d076fac1f4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.215445:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625c00/0xbacf56d076fac1f4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.215453:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625c00/0xbacf56d076fac1f4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.215459:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac683625c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969577.215463:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625c00/0xbacf56d076fac1f4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.215471:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625c00/0xbacf56d076fac1f4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.215487:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ac785197d00) 00010000:00010000:2.0:1783969577.215490:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969577.215494:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625c00/0xbacf56d076fac1f4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.215500:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625c00/0xbacf56d076fac1f4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969577.295507:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969577.295642:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272245248 00000100:00100000:3.0:1783969577.295662:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272245248 00000100:00100000:3.0:1783969577.295734:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:3.0:1783969577.295743:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+9:14383:x1870627272245248:12345-192.168.203.39@tcp:101:lctl.0 00010000:00010000:3.0:1783969577.295766:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969577.295789:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac1fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb635b0 expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.295854:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fac202 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.295894:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fac202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.295905:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fac202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969577.295982:0:14164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783969577.295986:0:14164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1783969577.296023:0:14164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fac202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.296047:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac1fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635b0 expref: 11 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.296077:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6000/0xbacf56d076fac202 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635b0 expref: 10 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.296085:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac78c550100) 00010000:00010000:3.0:1783969577.296088:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783969577.296091:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de6000, rc 0) 00000100:00100000:3.0:1783969577.296200:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+10:14383:x1870627272245248:12345-192.168.203.39@tcp:101:lctl.0 Request processed in 457us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969577.296207:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:3.0:1783969577.320952:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969577.321113:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272245376 00000100:00100000:2.0:1783969577.321123:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272245376 00000100:00100000:2.0:1783969577.321235:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:2.0:1783969577.321247:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:978405fc-0033-4402-91b7-b6ffa4f032e9+5:14384:x1870627272245376:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783969577.321265:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969577.321285:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac209 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb635b7 expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.321343:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fac210 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.321356:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fac210 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.321367:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fac210 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969577.322352:0:14163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783969577.322360:0:14163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1783969577.322476:0:14163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fac210 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.322511:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac209 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635b7 expref: 7 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.322532:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098e00/0xbacf56d076fac210 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635b7 expref: 6 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.322541:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac78c550100) 00010000:00010000:2.0:1783969577.322557:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783969577.322561:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786098e00, rc 0) 00000100:00100000:2.0:1783969577.322723:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:978405fc-0033-4402-91b7-b6ffa4f032e9+6:14384:x1870627272245376:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1464us (1765us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969577.322731:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:1.0:1783969577.326542:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969577.326634:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272245504 00000100:00100000:2.0:1783969577.326645:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272245504 00000100:00100000:2.0:1783969577.326780:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:2.0:1783969577.326792:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:978405fc-0033-4402-91b7-b6ffa4f032e9+6:14384:x1870627272245504:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783969577.326813:0:14821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969577.326835:0:14821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fac217 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb635be expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.326933:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac21e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.326948:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac21e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.326959:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac21e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.326973:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac225 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.326980:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.326986:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.327115:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fac22c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.327125:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fac22c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.327132:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fac22c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969577.327173:0:14821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1783969577.327178:0:14821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783969577.327201:0:14821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fac22c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.327212:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac21e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.327220:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac21e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.327226:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac21e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.327232:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786099400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969577.327236:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac21e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.327244:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac21e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.327256:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac78c550100) 00010000:00010000:2.0:1783969577.327265:0:14821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969577.327271:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac21e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.327277:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac21e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.327291:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.327297:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac225 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.327303:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac225 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.327308:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786098800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969577.327311:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac225 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.327317:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac225 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.327325:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ac785336f00) 00010000:00010000:2.0:1783969577.327327:0:14821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969577.327330:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac225 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.327336:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac225 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.327550:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fac217 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635be expref: 8 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.327580:0:14821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fac22c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635be expref: 7 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.327588:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ac785336400) 00010000:00010000:2.0:1783969577.327590:0:14821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783969577.327592:0:14821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786098000, rc 0) 00000100:00100000:2.0:1783969577.327662:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786092d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:978405fc-0033-4402-91b7-b6ffa4f032e9+7:14384:x1870627272245504:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 872us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969577.327670:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:0.0:1783969577.332187:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969577.332254:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272245760 00000100:00100000:1.0:1783969577.332264:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272245760 00000100:00100000:1.0:1783969577.332324:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 23 00000100:00100000:1.0:1783969577.332334:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:978405fc-0033-4402-91b7-b6ffa4f032e9+7:14384:x1870627272245760:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1783969577.332353:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969577.332538:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625800/0xbacf56d076fac233 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb635c5 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969577.332649:0:14162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1783969577.332768:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625800/0xbacf56d076fac233 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635c5 expref: 9 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.332782:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac78c550100) 00010000:00010000:1.0:1783969577.332785:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783969577.332791:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625800/0xbacf56d076fac233 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635c5 expref: 9 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.332805:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac683625800, rc 0) 00000100:00100000:1.0:1783969577.332913:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:978405fc-0033-4402-91b7-b6ffa4f032e9+8:14384:x1870627272245760:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 579us (734us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1783969577.332920:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 23 00000100:00100000:0.0:1783969577.339131:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969577.339289:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272246016 00000100:00100000:3.0:1783969577.339300:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272246016 00000100:00100000:3.0:1783969577.339359:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 24 00000100:00100000:3.0:1783969577.339583:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:978405fc-0033-4402-91b7-b6ffa4f032e9+8:14384:x1870627272246016:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:3.0:1783969577.339640:0:14164:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969577.339666:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fac22c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635be expref: 8 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.339686:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ac785336400) 00010000:00010000:3.0:1783969577.339724:0:14164:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783969577.339750:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac241 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.339762:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac241 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.339772:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac241 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783969577.340086:0:14164:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000031302988 reply state 0000000090fad159 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac241 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969577.340096:0:14164:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783969577.340112:0:14164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1783969577.340205:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:978405fc-0033-4402-91b7-b6ffa4f032e9+9:14384:x1870627272246016:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 827us (1083us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1783969577.340213:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 24 00010000:00010000:1.0:1783969577.343048:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac241 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.343075:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac241 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.343097:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac241 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.343103:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969577.343107:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac241 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.343114:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac241 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.343130:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ac78c550500) 00010000:00010000:1.0:1783969577.343134:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1783969577.343138:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac241 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.343145:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac241 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969577.345122:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969577.345357:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272246272 00000100:00100000:1.0:1783969577.345382:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272246272 00000100:00100000:1.0:1783969577.345443:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00100000:1.0:1783969577.345453:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:978405fc-0033-4402-91b7-b6ffa4f032e9+8:14384:x1870627272246272:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1783969577.345687:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:978405fc-0033-4402-91b7-b6ffa4f032e9+9:14384:x1870627272246272:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 235us (574us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1783969577.345695:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00100000:3.0:1783969577.350101:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969577.350254:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272246528 00000100:00100000:2.0:1783969577.350263:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272246528 00000100:00100000:2.0:1783969577.350318:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 25 00000100:00100000:2.0:1783969577.350328:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:978405fc-0033-4402-91b7-b6ffa4f032e9+9:14384:x1870627272246528:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1783969577.350351:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969577.350388:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac248 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb635cc expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.350621:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac24f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.350636:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac24f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.350648:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac24f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.350662:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac256 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.350680:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac256 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.350688:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac256 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969577.350816:0:14163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1783969577.350957:0:14163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac24f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.350966:0:14163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac24f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.350973:0:14163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac24f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.350979:0:14163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786099400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969577.350983:0:14163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac24f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.350990:0:14163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac24f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.351002:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac78c550100) 00010000:00010000:2.0:1783969577.351005:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969577.351010:0:14163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac24f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.351015:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac24f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.351040:0:14163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac256 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.351046:0:14163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac256 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.351052:0:14163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac256 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.351058:0:14163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786098400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969577.351073:0:14163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac256 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.351079:0:14163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac256 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.351087:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ac785336f00) 00010000:00010000:2.0:1783969577.351090:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969577.351092:0:14163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac256 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.351096:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac256 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.351132:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac248 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635cc expref: 11 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.351141:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac78c550100) 00010000:00010000:2.0:1783969577.351143:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783969577.351153:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac248 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635cc expref: 11 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.351163:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786098800, rc 0) 00000100:00100000:2.0:1783969577.351217:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:978405fc-0033-4402-91b7-b6ffa4f032e9+10:14384:x1870627272246528:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 890us (1125us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1783969577.351225:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 25 00000100:00100000:2.0:1783969577.354122:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969577.354200:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272246656 00000100:00100000:3.0:1783969577.354210:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272246656 00000100:00100000:3.0:1783969577.354269:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 26 00000100:00100000:3.0:1783969577.354279:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:978405fc-0033-4402-91b7-b6ffa4f032e9+10:14384:x1870627272246656:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1783969577.354302:0:14821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969577.354323:0:14821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fac264 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb635d3 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.354411:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fac26b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.354424:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fac26b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.354455:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fac26b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783969577.354503:0:14821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1783969577.354507:0:14821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783969577.354537:0:14821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fac26b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.354564:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fac264 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635d3 expref: 12 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.354581:0:14821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fac26b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635d3 expref: 11 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.354588:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ac78c550b00) 00010000:00010000:3.0:1783969577.354591:0:14821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783969577.354594:0:14821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de6800, rc 0) 00000100:00100000:3.0:1783969577.354657:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:978405fc-0033-4402-91b7-b6ffa4f032e9+11:14384:x1870627272246656:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 379us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969577.354666:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 26 00000100:00100000:0.0:1783969577.358487:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969577.358629:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272246784 00000100:00100000:2.0:1783969577.358638:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272246784 00000100:00100000:2.0:1783969577.358693:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3 00000100:00100000:2.0:1783969577.358703:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:978405fc-0033-4402-91b7-b6ffa4f032e9+11:14384:x1870627272246784:12345-192.168.203.39@tcp:37:lfs.0 00000100:00100000:1.0:1783969577.364285:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:978405fc-0033-4402-91b7-b6ffa4f032e9+11:14384:x1870627272246784:12345-192.168.203.39@tcp:37:lfs.0 Request processed in 5573us (5795us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969577.364299:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3 00000100:00100000:3.0:1783969577.368269:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969577.368349:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272247040 00000100:00100000:0.0:1783969577.368358:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272247040 00000100:00100000:0.0:1783969577.368423:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:0.0:1783969577.368442:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b6271450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:978405fc-0033-4402-91b7-b6ffa4f032e9+11:14384:x1870627272247040:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1783969577.368683:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b6271450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:978405fc-0033-4402-91b7-b6ffa4f032e9+12:14384:x1870627272247040:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 242us (421us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1783969577.368691:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:0.0:1783969577.414401:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969577.414611:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272247168 00000100:00100000:1.0:1783969577.414621:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272247168 00000100:00100000:1.0:1783969577.414680:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 27 00000100:00100000:1.0:1783969577.414690:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+10:14390:x1870627272247168:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:1.0:1783969577.414721:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969577.414740:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625800/0xbacf56d076fac272 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb635da expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.414798:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625c00/0xbacf56d076fac279 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.414811:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625c00/0xbacf56d076fac279 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.414822:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625c00/0xbacf56d076fac279 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.414836:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683624c00/0xbacf56d076fac280 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.414843:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683624c00/0xbacf56d076fac280 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.414850:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683624c00/0xbacf56d076fac280 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.415007:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625200/0xbacf56d076fac287 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.415016:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625200/0xbacf56d076fac287 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.415034:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625200/0xbacf56d076fac287 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969577.415077:0:14162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1783969577.415081:0:14162:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783969577.415125:0:14162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625200/0xbacf56d076fac287 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.415137:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625c00/0xbacf56d076fac279 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.415143:0:14162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625c00/0xbacf56d076fac279 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.415150:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625c00/0xbacf56d076fac279 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.415156:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac683625c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969577.415160:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625c00/0xbacf56d076fac279 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.415167:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625c00/0xbacf56d076fac279 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.415179:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac78c550100) 00010000:00010000:1.0:1783969577.415182:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969577.415186:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625c00/0xbacf56d076fac279 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.415193:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625c00/0xbacf56d076fac279 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.415219:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683624c00/0xbacf56d076fac280 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.415224:0:14162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683624c00/0xbacf56d076fac280 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.415229:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683624c00/0xbacf56d076fac280 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.415234:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac683624c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969577.415237:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683624c00/0xbacf56d076fac280 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.415243:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683624c00/0xbacf56d076fac280 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.415250:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9ac785197800) 00010000:00010000:1.0:1783969577.415252:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969577.415255:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683624c00/0xbacf56d076fac280 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.415261:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683624c00/0xbacf56d076fac280 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.415293:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625800/0xbacf56d076fac272 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635da expref: 12 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.415306:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625200/0xbacf56d076fac287 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635da expref: 11 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.415324:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ac78c550b00) 00010000:00010000:1.0:1783969577.415326:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783969577.415328:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac683625200, rc 0) 00000100:00100000:1.0:1783969577.415620:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+11:14390:x1870627272247168:12345-192.168.203.39@tcp:101:bash.0 Request processed in 930us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969577.415629:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 27 00000100:00100000:2.0:1783969577.424648:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969577.424923:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272247424 00000100:00100000:3.0:1783969577.424933:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272247424 00000100:00100000:3.0:1783969577.424991:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 28 00000100:00100000:3.0:1783969577.425000:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+11:14390:x1870627272247424:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:3.0:1783969577.425020:0:14821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969577.425039:0:14821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fac28e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb635e1 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.425179:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac295 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.425193:0:14821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fac26b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635d3 expref: 11 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.425202:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac295 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.425233:0:14821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fac26b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635d3 expref: 11 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.425245:0:14821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fac26b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635d3 expref: 11 pid: 14821 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969577.425258:0:14821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff34380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14821:1870627280622976:192.168.203.39@tcp:104: 00000100:00100000:3.0:1783969577.425343:0:14821:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac788723d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783969577.431206:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969577.431334:0:14821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff34380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14821:1870627280622976:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969577.431360:0:14821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac295 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969577.433617:0:14148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272247552 00000100:00100000:0.0:1783969577.433630:0:14148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272247552 00010000:00010000:0.0:1783969577.433678:0:14148:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fac26b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635d3 expref: 12 pid: 14821 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969577.433722:0:14148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:0.0:1783969577.433732:0:14148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:978405fc-0033-4402-91b7-b6ffa4f032e9+12:2350:x1870627272247552:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969577.433746:0:14148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969577.433752:0:14148:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fac26b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635d3 expref: 12 pid: 14821 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.433764:0:14148:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fac26b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635d3 expref: 12 pid: 14821 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.433784:0:14148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6800/0xbacf56d076fac26b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635d3 expref: 12 pid: 14821 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.433801:0:14148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ac78c550b00) 00010000:00010000:0.0:1783969577.433805:0:14148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac295 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.433814:0:14148:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac295 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.433821:0:14148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac295 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.433887:0:14148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969577.433945:0:14148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:978405fc-0033-4402-91b7-b6ffa4f032e9+11:2350:x1870627272247552:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 214us (2862us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969577.433965:0:14148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 10 00010000:00010000:2.0:1783969577.435229:0:14821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac295 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.435244:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac295 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.435271:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac29c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.435283:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac29c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.435292:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac29c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.437565:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac2a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.437583:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac2a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.437593:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac2a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969577.437603:0:14821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783969577.437630:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac295 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.437636:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac295 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.437643:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac295 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.437648:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969577.437652:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac295 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.437659:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac295 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.437670:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ac78c550b00) 00010000:00010000:2.0:1783969577.437673:0:14821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783969577.437676:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac295 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.437697:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6600/0xbacf56d076fac295 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783969577.437713:0:14821:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003b33b408 reply state 00000000137e5043 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac29c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969577.437720:0:14821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783969577.437756:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fac28e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635e1 expref: 14 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.437771:0:14821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac2a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635e1 expref: 13 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.437777:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac785336800) 00010000:00010000:2.0:1783969577.437780:0:14821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1783969577.437782:0:14821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786099400, rc 0) 00000100:00100000:2.0:1783969577.439158:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+14:14390:x1870627272247424:12345-192.168.203.39@tcp:101:bash.0 Request processed in 14152us (14601us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1783969577.439170:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 28 00010000:00010000:3.0:1783969577.448199:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac29c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.448217:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac29c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.448226:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac29c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.448233:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786098400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969577.448251:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac29c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.448259:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac29c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.448274:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9ac785336f00) 00010000:00010000:3.0:1783969577.448277:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969577.448281:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac29c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.448287:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac29c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969577.467295:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969577.467402:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272247680 00000100:00100000:1.0:1783969577.467411:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272247680 00000100:00100000:1.0:1783969577.467489:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 29 00000100:00100000:1.0:1783969577.467500:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+13:14390:x1870627272247680:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:1.0:1783969577.467523:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783969577.467543:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625c00/0xbacf56d076fac2b1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb635e8 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.467608:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625a00/0xbacf56d076fac2b8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.467621:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625a00/0xbacf56d076fac2b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.467633:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625a00/0xbacf56d076fac2b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783969577.467668:0:14162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1783969577.467673:0:14162:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783969577.467700:0:14162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625a00/0xbacf56d076fac2b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.467728:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625a00/0xbacf56d076fac2b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.467761:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625c00/0xbacf56d076fac2b1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635e8 expref: 15 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.467780:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625a00/0xbacf56d076fac2b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635e8 expref: 14 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.467789:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac785336800) 00010000:00010000:1.0:1783969577.467791:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783969577.467795:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac683625a00, rc 0) 00000100:00100000:1.0:1783969577.467908:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+14:14390:x1870627272247680:12345-192.168.203.39@tcp:101:bash.0 Request processed in 409us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969577.467915:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 29 00000100:00100000:2.0:1783969577.471038:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969577.472550:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272247936 00000100:00100000:0.0:1783969577.472562:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272247936 00000100:00100000:0.0:1783969577.472622:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:0.0:1783969577.472633:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+14:14390:x1870627272247936:12345-192.168.203.39@tcp:35:bash.0 00000100:00100000:0.0:1783969577.473757:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+15:14390:x1870627272247936:12345-192.168.203.39@tcp:35:bash.0 Request processed in 1119us (2719us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1783969577.473767:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:0.0:1783969577.542031:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969577.542137:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969577.542176:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969577.543486:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272248192 00000100:00100000:3.0:1783969577.543499:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272248192 00000100:00100000:3.0:1783969577.543579:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272248448 00000100:00100000:3.0:1783969577.543582:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272248448 00000100:00100000:3.0:1783969577.543606:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:3.0:1783969577.543615:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+5:2351:x1870627272248192:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969577.543687:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+5:2351:x1870627272248192:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 73us (1549us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969577.543694:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:3.0:1783969577.543710:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:3.0:1783969577.543715:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:978405fc-0033-4402-91b7-b6ffa4f032e9+5:2351:x1870627272248448:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1783969577.543737:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:978405fc-0033-4402-91b7-b6ffa4f032e9+5:2351:x1870627272248448:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 22us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969577.543742:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00080000:0.0:1783969577.544328:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783969577.546008:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969577.546051:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969577.546213:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272248320 00000100:00100000:0.0:1783969577.546222:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272248320 00000100:00100000:0.0:1783969577.546277:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272248576 00000100:00100000:0.0:1783969577.546281:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272248576 00000100:00100000:0.0:1783969577.546298:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00100000:0.0:1783969577.546307:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+5:2350:x1870627272248320:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969577.546389:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+5:2350:x1870627272248320:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 82us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969577.546397:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00100000:0.0:1783969577.546413:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:0.0:1783969577.546420:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:978405fc-0033-4402-91b7-b6ffa4f032e9+5:2350:x1870627272248576:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1783969577.546444:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:978405fc-0033-4402-91b7-b6ffa4f032e9+5:2350:x1870627272248576:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 25us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969577.546463:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00080000:2.0:1783969577.547289:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783969577.548834:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272248064 00000100:00100000:1.0:1783969577.548848:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272248064 00000100:00100000:1.0:1783969577.549068:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 122 00000100:00100000:1.0:1783969577.549079:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+13:2350:x1870627272248064:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1783969577.549169:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2bdf8e85-d598-4892-bfdb-3f724decfbe5+13:2350:x1870627272248064:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 91us (7148us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969577.549177:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 122 00000100:00100000:2.0:1783969577.563603:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969577.563849:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272248832 00000100:00100000:0.0:1783969577.563904:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272248832 00000100:00100000:0.0:1783969577.564006:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 30 00000100:00100000:0.0:1783969577.564017:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+15:14400:x1870627272248832:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783969577.564041:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969577.564072:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128200/0xbacf56d076fac2bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb635ef expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969577.564188:0:14164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1783969577.564312:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128200/0xbacf56d076fac2bf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635ef expref: 17 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.564327:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ac78c550100) 00010000:00010000:0.0:1783969577.564330:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783969577.564335:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128200/0xbacf56d076fac2bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635ef expref: 17 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.564349:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac681128200, rc 0) 00000100:00100000:0.0:1783969577.564419:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+16:14400:x1870627272248832:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 404us (824us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1783969577.564426:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 30 00000100:00100000:3.0:1783969577.567729:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969577.568102:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272249088 00000100:00100000:1.0:1783969577.568113:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272249088 00000100:00100000:1.0:1783969577.568176:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:1.0:1783969577.568187:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+16:14400:x1870627272249088:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1783969577.568600:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+17:14400:x1870627272249088:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 414us (893us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1783969577.568608:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:1.0:1783969577.609201:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969577.609301:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272249344 00000100:00100000:0.0:1783969577.609311:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272249344 00000100:00100000:0.0:1783969577.609380:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 31 00000100:00100000:0.0:1783969577.609391:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+17:14403:x1870627272249344:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1783969577.609440:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969577.609461:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128200/0xbacf56d076fac2cd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb635f6 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.609557:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128e00/0xbacf56d076fac2d4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.609570:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128e00/0xbacf56d076fac2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.609582:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128e00/0xbacf56d076fac2d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969577.609593:0:14162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783969577.609714:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128200/0xbacf56d076fac2cd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635f6 expref: 20 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.609732:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128e00/0xbacf56d076fac2d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635f6 expref: 19 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.609741:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac785336800) 00010000:00010000:0.0:1783969577.609744:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969577.609747:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac681128e00, rc 0) 00000100:00100000:0.0:1783969577.609809:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786092680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+19:14403:x1870627272249344:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 419us (617us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1783969577.609816:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 31 00000100:00100000:3.0:1783969577.613844:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969577.614138:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272249472 00000100:00100000:2.0:1783969577.614148:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272249472 00000100:00100000:2.0:1783969577.614208:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 32 00000100:00100000:2.0:1783969577.614218:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+19:14403:x1870627272249472:12345-192.168.203.39@tcp:54:lfs.0 00010000:00010000:2.0:1783969577.614299:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac2e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.614315:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.614327:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.614353:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.614360:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac2e2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.614378:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac2e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.614384:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786098800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969577.614388:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac2e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.614396:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac2e2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.614406:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac785336800) 00010000:00010000:2.0:1783969577.614409:0:14821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783969577.614413:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac2e2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.614418:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac2e2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969577.614507:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+19:14403:x1870627272249472:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 291us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969577.614515:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 32 00000100:00100000:3.0:1783969577.618410:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969577.618530:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272249728 00000100:00100000:1.0:1783969577.618541:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272249728 00000100:00100000:1.0:1783969577.618602:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:1.0:1783969577.618612:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+19:14403:x1870627272249728:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:1.0:1783969577.618899:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+20:14403:x1870627272249728:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 286us (495us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1783969577.618906:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:1.0:1783969577.623694:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969577.623900:0:14150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272249856 00000100:00100000:2.0:1783969577.623910:0:14150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272249856 00000100:00100000:2.0:1783969577.623976:0:14150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:2.0:1783969577.623986:0:14150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786091f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+20:2351:x1870627272249856:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783969577.624004:0:14150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969577.624028:0:14150:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128e00/0xbacf56d076fac2d4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635f6 expref: 20 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.624047:0:14150:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac785336800) 00010000:00010000:2.0:1783969577.624051:0:14150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783969577.624118:0:14150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786091f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+19:2351:x1870627272249856:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 133us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969577.624126:0:14150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 0 00010000:00010000:1.0:1783969577.765133:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783969577.887389:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969577.887617:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272250112 00000100:00100000:0.0:1783969577.887628:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272250112 00000100:00100000:0.0:1783969577.887692:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 33 00000100:00100000:0.0:1783969577.887716:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+19:14434:x1870627272250112:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:0.0:1783969577.887741:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969577.887763:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128200/0xbacf56d076fac2e9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb635fd expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.887907:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128e00/0xbacf56d076fac2f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.887923:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128e00/0xbacf56d076fac2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.887935:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128e00/0xbacf56d076fac2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969577.887946:0:14162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783969577.888104:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128200/0xbacf56d076fac2e9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635fd expref: 22 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.888121:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128e00/0xbacf56d076fac2f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635fd expref: 21 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.888130:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac785336800) 00010000:00010000:0.0:1783969577.888132:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783969577.888135:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac681128e00, rc 0) 00000100:00100000:0.0:1783969577.888195:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+21:14434:x1870627272250112:12345-192.168.203.39@tcp:101:cat.0 Request processed in 480us (815us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1783969577.888203:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 33 00000100:00100000:3.0:1783969577.892369:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969577.892420:0:14148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272250240 00000100:00100000:0.0:1783969577.892428:0:14148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272250240 00000100:00100000:3.0:1783969577.892463:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969577.892509:0:14148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1 00000100:00100000:0.0:1783969577.892519:0:14148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+21:2350:x1870627272250240:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969577.892536:0:14148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969577.892571:0:14148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128e00/0xbacf56d076fac2f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635fd expref: 21 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.892589:0:14148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac785336800) 00010000:00010000:0.0:1783969577.892602:0:14148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969577.892656:0:14148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+20:2350:x1870627272250240:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 139us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969577.892664:0:14148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1 00000100:00100000:1.0:1783969577.892730:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272250496 00000100:00100000:1.0:1783969577.892734:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272250496 00000100:00100000:1.0:1783969577.892771:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:1.0:1783969577.892779:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+20:14434:x1870627272250496:12345-192.168.203.39@tcp:35:cat.0 00000100:00100000:1.0:1783969577.893095:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+21:14434:x1870627272250496:12345-192.168.203.39@tcp:35:cat.0 Request processed in 304us (619us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1783969577.893102:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:1.0:1783969577.978014:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969577.978129:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272250752 00000100:00100000:2.0:1783969577.978138:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272250752 00000100:00100000:2.0:1783969577.978200:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 34 00000100:00100000:2.0:1783969577.978210:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+21:14440:x1870627272250752:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1783969577.978232:0:14821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969577.978251:0:14821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac2fe lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63604 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.978348:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099200/0xbacf56d076fac305 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.978387:0:14821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac2a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635e1 expref: 22 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.978395:0:14821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625a00/0xbacf56d076fac2b8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635e8 expref: 22 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.978402:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099200/0xbacf56d076fac305 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.978437:0:14821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625a00/0xbacf56d076fac2b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635e8 expref: 22 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.978450:0:14821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625a00/0xbacf56d076fac2b8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635e8 expref: 22 pid: 14162 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969577.978463:0:14821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff3bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14821:1870627280623104:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969577.978555:0:14821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac2a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635e1 expref: 22 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.978573:0:14821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac2a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635e1 expref: 22 pid: 14821 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969577.978583:0:14821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff3aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14821:1870627280623232:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783969577.978607:0:14821:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7877cdcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783969577.984242:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969577.984280:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969577.984669:0:14149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272251008 00000100:00100000:0.0:1783969577.984678:0:14149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272251008 00010000:00010000:0.0:1783969577.984739:0:14149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac2a3 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635e1 expref: 23 pid: 14821 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969577.984774:0:14149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272250880 00000100:00100000:0.0:1783969577.984778:0:14149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272250880 00010000:00010000:0.0:1783969577.984789:0:14149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625a00/0xbacf56d076fac2b8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635e8 expref: 24 pid: 14162 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969577.984809:0:14149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:0.0:1783969577.984819:0:14149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac791057050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+24:2349:x1870627272251008:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969577.984834:0:14149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969577.984842:0:14149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac2a3 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635e1 expref: 24 pid: 14821 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.984901:0:14149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac2a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635e1 expref: 24 pid: 14821 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.984925:0:14149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac785336800) 00010000:00010000:0.0:1783969577.984931:0:14149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099200/0xbacf56d076fac305 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.984939:0:14149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099200/0xbacf56d076fac305 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.984945:0:14149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969577.984991:0:14149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac791057050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+24:2349:x1870627272251008:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 173us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969577.984999:0:14149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:0.0:1783969577.985038:0:14149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00100000:0.0:1783969577.985044:0:14149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+23:2349:x1870627272250880:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969577.985051:0:14149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969577.985066:0:14149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625a00/0xbacf56d076fac2b8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635e8 expref: 23 pid: 14162 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.985077:0:14149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625a00/0xbacf56d076fac2b8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635e8 expref: 23 pid: 14162 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.985088:0:14149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac785336800) 00010000:00010000:0.0:1783969577.985092:0:14149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099200/0xbacf56d076fac305 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.985110:0:14149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099200/0xbacf56d076fac305 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.985117:0:14149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099200/0xbacf56d076fac305 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.985133:0:14149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969577.985149:0:14149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+23:2349:x1870627272250880:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 105us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969577.985155:0:14149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 12 00010000:00010000:2.0:1783969577.986320:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac683625a00/0xbacf56d076fac2b8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635e8 expref: 22 pid: 14162 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969577.986354:0:14821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff3bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14821:1870627280623104:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969577.986379:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac2a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb635e1 expref: 21 pid: 14821 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969577.986390:0:14821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff3aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14821:1870627280623232:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969577.986410:0:14821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099200/0xbacf56d076fac305 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.986419:0:14821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099200/0xbacf56d076fac305 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.986425:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099200/0xbacf56d076fac305 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969577.986444:0:14821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783969577.986599:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac2fe lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63604 expref: 22 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.986613:0:14821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099200/0xbacf56d076fac305 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63604 expref: 21 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969577.986622:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac785336800) 00010000:00010000:2.0:1783969577.986625:0:14821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783969577.986627:0:14821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786099200, rc 0) 00000100:00100000:2.0:1783969577.986675:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786091500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+21:14440:x1870627272250752:12345-192.168.203.39@tcp:101:dd.0 Request processed in 8467us (8671us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1783969577.986690:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 34 00000100:00100000:3.0:1783969577.992317:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969577.992498:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272251264 00000100:00100000:0.0:1783969577.992509:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272251264 00000100:00100000:0.0:1783969577.992608:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 35 00000100:00100000:0.0:1783969577.992620:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+21:14440:x1870627272251264:12345-192.168.203.39@tcp:36:dd.0 00010000:00010000:0.0:1783969577.992936:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128e00/0xbacf56d076fac313 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.992953:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128e00/0xbacf56d076fac313 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969577.992964:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128e00/0xbacf56d076fac313 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783969577.993017:0:14162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1783969577.993053:0:14162:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d7a52e6d reply state 0000000063e46112 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128e00/0xbacf56d076fac313 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969577.993073:0:14162:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783969577.993166:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+24:14440:x1870627272251264:12345-192.168.203.39@tcp:36:dd.0 Request processed in 547us (858us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1783969577.993189:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 35 00000020:00080000:0.0:1783969577.993194:0:14162:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1783969577.996115:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969577.996152:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272251392 00000100:00100000:3.0:1783969577.996161:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272251392 00000100:00100000:3.0:1783969577.996209:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 36 00000100:00100000:3.0:1783969577.996219:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+24:14440:x1870627272251392:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:3.0:1783969577.996240:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969577.996260:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6e00/0xbacf56d076fac31a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6360b expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.996325:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6e00/0xbacf56d076fac31a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6360b expref: 25 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.996340:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6e00/0xbacf56d076fac31a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6360b expref: 25 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969577.996365:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac785336800) 00010000:00010000:3.0:1783969577.996368:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783969577.996372:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de6e00, rc 0) 00000100:00100000:3.0:1783969577.996430:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+25:14440:x1870627272251392:12345-192.168.203.39@tcp:101:dd.0 Request processed in 213us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969577.996452:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 36 00010000:00010000:1.0:1783969577.996530:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128e00/0xbacf56d076fac313 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.996539:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128e00/0xbacf56d076fac313 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.996556:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128e00/0xbacf56d076fac313 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.996570:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac681128e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:1.0:1783969577.996574:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128e00/0xbacf56d076fac313 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.996581:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128e00/0xbacf56d076fac313 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.996593:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac785336800) 00010000:00010000:1.0:1783969577.996596:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783969577.996600:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128e00/0xbacf56d076fac313 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969577.996606:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128e00/0xbacf56d076fac313 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969578.011777:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969578.011946:0:14149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272251648 00000100:00100000:0.0:1783969578.011956:0:14149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272251648 00000100:00100000:0.0:1783969578.012033:0:14149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00100000:0.0:1783969578.012043:0:14149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786093800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+24:14440:x1870627272251648:12345-192.168.203.39@tcp:103:dd.0 00010000:00010000:0.0:1783969578.012068:0:14149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969578.012095:0:14149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6e00/0xbacf56d076fac31a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6360b expref: 24 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.012113:0:14149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac785336800) 00010000:00010000:0.0:1783969578.012118:0:14149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969578.012209:0:14149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786093800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+23:14440:x1870627272251648:12345-192.168.203.39@tcp:103:dd.0 Request processed in 167us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969578.012218:0:14149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00100000:0.0:1783969578.014978:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969578.015050:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272251776 00000100:00100000:2.0:1783969578.015066:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272251776 00000100:00100000:2.0:1783969578.015119:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 37 00000100:00100000:2.0:1783969578.015129:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf6b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+23:14440:x1870627272251776:12345-192.168.203.39@tcp:58:dd.0 00010000:00010000:2.0:1783969578.015212:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac321 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.015227:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac321 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.015238:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac321 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783969578.016044:0:14163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783969578.016203:0:14163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1783969578.016268:0:14163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1783969578.016357:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf6b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+23:14440:x1870627272251776:12345-192.168.203.39@tcp:58:dd.0 Request processed in 1227us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969578.016366:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 37 00000100:00100000:3.0:1783969578.018463:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969578.018532:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272251904 00000100:00100000:0.0:1783969578.018540:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272251904 00000100:00100000:0.0:1783969578.018591:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 38 00000100:00100000:0.0:1783969578.018600:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+23:14440:x1870627272251904:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:0.0:1783969578.018620:0:14821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783969578.018639:0:14821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129e00/0xbacf56d076fac328 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63612 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.018689:0:14821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac321 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.018726:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129e00/0xbacf56d076fac328 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63612 expref: 24 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.018745:0:14821:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac321 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.018758:0:14821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129e00/0xbacf56d076fac328 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63612 expref: 24 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.018772:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac785336800) 00010000:00010000:0.0:1783969578.018776:0:14821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783969578.018780:0:14821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129e00/0xbacf56d076fac328 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63612 expref: 24 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.018788:0:14821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac681129e00, rc 0) 00000100:00100000:0.0:1783969578.018845:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+24:14440:x1870627272251904:12345-192.168.203.39@tcp:101:dd.0 Request processed in 245us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969578.018852:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 38 00000040:00080000:0.0:1783969578.213233:0:14197:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783969578.213242:0:14197:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783969578.213279:0:14197:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1783969578.213284:0:14197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1783969578.213401:0:14197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbc380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14197:1870627280623360:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783969578.213504:0:14197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac78613ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1783969578.220067:0:14197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbc380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14197:1870627280623360:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783969578.229356:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969578.232525:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272252032 00000100:00100000:0.0:1783969578.232552:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272252032 00000100:00100000:0.0:1783969578.232627:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:0.0:1783969578.232638:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+24:14441:x1870627272252032:12345-192.168.203.39@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1783969578.232731:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786090a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+24:14441:x1870627272252032:12345-192.168.203.39@tcp:900:lhsmtool_posix.0 Request processed in 94us (3384us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969578.232738:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:3.0:1783969578.239286:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969578.239403:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272252160 00000100:00100000:2.0:1783969578.239412:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272252160 00000100:00100000:2.0:1783969578.239468:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 39 00000100:00100000:2.0:1783969578.239478:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+24:14441:x1870627272252160:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783969578.239519:0:14163:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783969578.240212:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+24:14441:x1870627272252160:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 Request processed in 734us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969578.240220:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 39 00000100:00100000:2.0:1783969578.244343:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969578.244469:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272252288 00000100:00100000:0.0:1783969578.244478:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272252288 00000100:00100000:0.0:1783969578.244538:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 40 00000100:00100000:0.0:1783969578.244549:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+24:14441:x1870627272252288:12345-192.168.203.39@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1783969578.244618:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129600/0xbacf56d076fac32f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.244637:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129600/0xbacf56d076fac32f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.244648:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129600/0xbacf56d076fac32f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.244664:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128c00/0xbacf56d076fac336 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.244671:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128c00/0xbacf56d076fac336 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.244677:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128c00/0xbacf56d076fac336 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.244699:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129c00/0xbacf56d076fac33d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.244725:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129c00/0xbacf56d076fac33d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.244742:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129c00/0xbacf56d076fac33d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783969578.244779:0:14821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1783969578.244783:0:14821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783969578.244799:0:14821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129c00/0xbacf56d076fac33d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.244809:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129600/0xbacf56d076fac32f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.244822:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129600/0xbacf56d076fac32f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.244828:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129600/0xbacf56d076fac32f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.244834:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac681129600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969578.244838:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129600/0xbacf56d076fac32f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.244845:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129600/0xbacf56d076fac32f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.244856:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac78c550a00) 00010000:00010000:0.0:1783969578.244894:0:14821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969578.244899:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129600/0xbacf56d076fac32f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.244915:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129600/0xbacf56d076fac32f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.244930:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128c00/0xbacf56d076fac336 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.244936:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128c00/0xbacf56d076fac336 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.244942:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128c00/0xbacf56d076fac336 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.244947:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac681128c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969578.244950:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128c00/0xbacf56d076fac336 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.244956:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128c00/0xbacf56d076fac336 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.244965:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9ac785186400) 00010000:00010000:0.0:1783969578.244968:0:14821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969578.244970:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128c00/0xbacf56d076fac336 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.244976:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128c00/0xbacf56d076fac336 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.244989:0:14821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129c00/0xbacf56d076fac33d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.244995:0:14821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129c00/0xbacf56d076fac33d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.245008:0:14821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129c00/0xbacf56d076fac33d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.245013:0:14821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac681129c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969578.245016:0:14821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129c00/0xbacf56d076fac33d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.245022:0:14821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129c00/0xbacf56d076fac33d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.245029:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac785336800) 00010000:00010000:0.0:1783969578.245031:0:14821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969578.245034:0:14821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129c00/0xbacf56d076fac33d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.245038:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129c00/0xbacf56d076fac33d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969578.245256:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+24:14441:x1870627272252288:12345-192.168.203.39@tcp:34:lhsmtool_posix.0 Request processed in 707us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969578.245264:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 40 00000100:00100000:0.0:1783969578.249188:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969578.249229:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272252544 00000100:00100000:2.0:1783969578.249238:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272252544 00000100:00100000:2.0:1783969578.249337:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 41 00000100:00100000:2.0:1783969578.249348:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+24:14441:x1870627272252544:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783969578.249436:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969578.249457:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fac344 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63619 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.249572:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fac34b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.249588:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fac34b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.249610:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fac34b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969578.249622:0:14162:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783969578.249726:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fac34b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.249733:0:14162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fac34b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.249740:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fac34b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.249746:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786099600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:2.0:1783969578.249750:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fac34b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.249776:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fac34b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.249788:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac785336800) 00010000:00010000:2.0:1783969578.249791:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783969578.249794:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fac34b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.249800:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fac34b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.249841:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fac344 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63619 expref: 26 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.249884:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ac78c550a00) 00010000:00010000:2.0:1783969578.249887:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783969578.249891:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fac344 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63619 expref: 26 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.249902:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786098000, rc 0) 00000100:00100000:2.0:1783969578.250102:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+25:14441:x1870627272252544:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 755us (922us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1783969578.250109:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 41 00000100:00100000:2.0:1783969578.266327:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969578.266516:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272252672 00000100:00100000:0.0:1783969578.266526:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272252672 00000100:00100000:0.0:1783969578.266704:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 42 00000100:00100000:0.0:1783969578.266715:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+25:14441:x1870627272252672:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783969578.266756:0:14821:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783969578.266899:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+25:14441:x1870627272252672:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 Request processed in 185us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969578.266921:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 42 00000100:00100000:1.0:1783969578.275022:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969578.275157:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272252928 00000100:00100000:3.0:1783969578.275167:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272252928 00000100:00100000:3.0:1783969578.275276:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 43 00000100:00100000:3.0:1783969578.275288:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+25:14441:x1870627272252928:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783969578.275318:0:14163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783969578.275339:0:14163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6400/0xbacf56d076fac359 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63620 expref: -99 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783969578.277552:0:14163:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:3.0:1783969578.277564:0:14163:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1783969578.277634:0:14163:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:3.0:1783969578.278129:0:14163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6200/0xbacf56d076fac360 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.278145:0:14163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6200/0xbacf56d076fac360 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.278158:0:14163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6200/0xbacf56d076fac360 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.278224:0:14163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6400/0xbacf56d076fac359 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63620 expref: 28 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.278242:0:14163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6200/0xbacf56d076fac360 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63620 expref: 27 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.278263:0:14163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ac78c550f00) 00010000:00010000:3.0:1783969578.278266:0:14163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783969578.278269:0:14163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac783de6200, rc 0) 00000100:00100000:3.0:1783969578.278361:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786093b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+27:14441:x1870627272252928:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 3074us (3348us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1783969578.278369:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 43 00000100:00100000:1.0:1783969578.284481:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969578.284657:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272253184 00000100:00100000:3.0:1783969578.284667:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272253184 00000100:00100000:3.0:1783969578.284723:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 44 00000100:00100000:3.0:1783969578.284733:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+27:14441:x1870627272253184:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783969578.284783:0:14164:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969578.284809:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6200/0xbacf56d076fac360 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63620 expref: 27 pid: 14163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.284827:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ac78c550f00) 00010000:00010000:3.0:1783969578.284836:0:14164:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783969578.284888:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6e00/0xbacf56d076fac36e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.284901:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6e00/0xbacf56d076fac36e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.284910:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6e00/0xbacf56d076fac36e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.284924:0:14164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fac375 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x743c492f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.284946:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fac375 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x743c492f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.285136:0:14164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fac375 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x743c492f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.285209:0:14164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6e00/0xbacf56d076fac36e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.285216:0:14164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6e00/0xbacf56d076fac36e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.285223:0:14164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6e00/0xbacf56d076fac36e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.285229:0:14164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6e00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969578.285233:0:14164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6e00/0xbacf56d076fac36e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.285242:0:14164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6e00/0xbacf56d076fac36e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.285251:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ac78c550b00) 00010000:00010000:3.0:1783969578.285253:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969578.285257:0:14164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6e00/0xbacf56d076fac36e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.285262:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de6e00/0xbacf56d076fac36e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.285270:0:14164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fac375 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x743c492f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.285282:0:14164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fac375 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x743c492f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.285287:0:14164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fac375 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x743c492f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.285291:0:14164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de7600 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969578.285294:0:14164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fac375 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x743c492f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.285299:0:14164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fac375 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x743c492f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.285307:0:14164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x743c492f (ffff9ac78c550000) 00010000:00010000:3.0:1783969578.286159:0:14164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969578.286169:0:14164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fac375 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x743c492f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.286178:0:14164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac783de7600/0xbacf56d076fac375 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x743c492f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969578.286275:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786090700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+26:14441:x1870627272253184:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 1540us (1801us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783969578.286283:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 44 00000100:00100000:0.0:1783969578.302223:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969578.302317:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272253312 00000100:00100000:2.0:1783969578.302327:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272253312 00000100:00100000:2.0:1783969578.302391:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 45 00000100:00100000:2.0:1783969578.302401:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+26:14441:x1870627272253312:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783969578.302433:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969578.302457:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fac37c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63627 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.302496:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fac383 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.302509:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fac383 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.302520:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fac383 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.302632:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fac37c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63627 expref: 28 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.302650:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099600/0xbacf56d076fac383 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63627 expref: 27 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.302658:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ac785336a00) 00010000:00010000:2.0:1783969578.302661:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783969578.302664:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786099600, rc 0) 00000100:00100000:2.0:1783969578.302716:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+27:14441:x1870627272253312:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 317us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969578.302724:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 45 00000100:00100000:1.0:1783969578.309343:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969578.309900:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272253568 00000100:00100000:0.0:1783969578.309911:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272253568 00000100:00100000:0.0:1783969578.309978:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 46 00000100:00100000:0.0:1783969578.309988:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+27:14441:x1870627272253568:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783969578.310078:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128c00/0xbacf56d076fac38a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.310095:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128c00/0xbacf56d076fac38a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.310107:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128c00/0xbacf56d076fac38a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783969578.310503:0:14821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1783969578.310514:0:14821:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 435392653518ns, next at 436392651072ns, rc = 0 00000004:00010000:0.0:1783969578.310595:0:14821:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ec15b4c7 reply state 00000000e082d363 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128c00/0xbacf56d076fac38a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969578.310606:0:14821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783969578.310704:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786093480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+29:14441:x1870627272253568:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 716us (1368us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1783969578.310711:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 46 00010000:00010000:3.0:1783969578.312376:0:3271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128c00/0xbacf56d076fac38a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.312392:0:3271:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128c00/0xbacf56d076fac38a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.312418:0:3271:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128c00/0xbacf56d076fac38a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.312424:0:3271:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac681128c00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969578.312429:0:3271:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128c00/0xbacf56d076fac38a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.312436:0:3271:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128c00/0xbacf56d076fac38a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.312452:0:3271:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ac785336a00) 00010000:00010000:3.0:1783969578.312455:0:3271:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783969578.312460:0:3271:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128c00/0xbacf56d076fac38a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.312466:0:3271:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128c00/0xbacf56d076fac38a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969578.314075:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969578.314265:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272253696 00000100:00100000:2.0:1783969578.314275:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272253696 00000100:00100000:2.0:1783969578.314329:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 47 00000100:00100000:2.0:1783969578.314338:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+28:14441:x1870627272253696:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783969578.314382:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969578.314402:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac391 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6362e expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.314462:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac391 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6362e expref: 29 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.314477:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac391 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6362e expref: 29 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.314497:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ac785336a00) 00010000:00010000:2.0:1783969578.314500:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783969578.314504:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786099400, rc 0) 00000100:00100000:2.0:1783969578.314661:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786093100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+29:14441:x1870627272253696:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 323us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969578.314668:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 47 00000100:00100000:1.0:1783969578.318111:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969578.321737:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272253824 00000100:00100000:0.0:1783969578.321753:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272253824 00000100:00100000:0.0:1783969578.321899:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00100000:0.0:1783969578.321911:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+5:2351:x1870627272253824:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1783969578.322297:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786090380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+6:2351:x1870627272253824:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 Request processed in 386us (4194us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1783969578.322305:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00100000:2.0:1783969578.327471:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969578.327578:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272254080 00000100:00100000:1.0:1783969578.327587:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272254080 00000100:00100000:1.0:1783969578.327643:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:1.0:1783969578.327654:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+29:14441:x1870627272254080:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783969578.327921:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+30:14441:x1870627272254080:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 267us (457us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1783969578.327929:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:1.0:1783969578.332728:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969578.332825:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272254336 00000100:00100000:2.0:1783969578.332834:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272254336 00000100:00100000:2.0:1783969578.332918:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 48 00000100:00100000:2.0:1783969578.332929:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+30:14441:x1870627272254336:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783969578.333040:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786091180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+30:14441:x1870627272254336:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 112us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969578.333048:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 48 00000100:00100000:3.0:1783969578.335374:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969578.335507:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272254464 00000100:00100000:2.0:1783969578.335515:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272254464 00000100:00100000:2.0:1783969578.335582:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 49 00000100:00100000:2.0:1783969578.335591:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+30:14441:x1870627272254464:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783969578.335609:0:14162:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969578.335628:0:14162:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac398 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63635 expref: -99 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.335693:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fac39f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.335706:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fac39f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.335718:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fac39f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783969578.335762:0:14162:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783969578.335780:0:14162:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fac39f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.335802:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098400/0xbacf56d076fac398 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63635 expref: 32 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.335818:0:14162:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fac39f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63635 expref: 31 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.335826:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ac785336a00) 00010000:00010000:2.0:1783969578.335829:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783969578.335833:0:14162:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786098000, rc 0) 00000100:00100000:2.0:1783969578.335927:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+31:14441:x1870627272254464:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 337us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969578.335943:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 49 00000100:00100000:1.0:1783969578.343932:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969578.346324:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272254592 00000100:00100000:2.0:1783969578.346338:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272254592 00000100:00100000:2.0:1783969578.346406:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:2.0:1783969578.346416:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+6:2350:x1870627272254592:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783969578.346433:0:14799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969578.346455:0:14799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b39416df/0xbacf56d076fac3a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb6363c expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783969578.346483:0:14799:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a55372a, blocks: 0x1 00010000:00010000:2.0:1783969578.346502:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=435s v=(0 0) 00010000:00010000:2.0:1783969578.346507:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969578.346517:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b39416df/0xbacf56d076fac3a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6363c expref: 7 pid: 14799 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.346536:0:14799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b39416df/0xbacf56d076fac3a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6363c expref: 7 pid: 14799 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.346550:0:14799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac786098400, rc 0) 00000100:00100000:2.0:1783969578.346616:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786091f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+7:2350:x1870627272254592:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 201us (2695us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969578.346624:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:0.0:1783969578.350931:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969578.351142:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272254848 00000100:00100000:2.0:1783969578.351152:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272254848 00000100:00100000:2.0:1783969578.351208:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 50 00000100:00100000:2.0:1783969578.351219:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+31:14441:x1870627272254848:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783969578.351340:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+31:14441:x1870627272254848:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 123us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969578.351349:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 50 00000100:00100000:1.0:1783969578.353784:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969578.354087:0:14163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272254976 00000100:00100000:3.0:1783969578.354097:0:14163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272254976 00000100:00100000:3.0:1783969578.354245:0:14163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 51 00000100:00100000:3.0:1783969578.354256:0:14163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac786092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+31:14441:x1870627272254976:12345-192.168.203.39@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1783969578.424848:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:3.0:1783969578.424879:0:5816:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1783969578.424909:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1783969578.425048:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280623488:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1783969578.425124:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969578.425215:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280623488 00000100:00100000:3.0:1783969578.425222:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280623488 00000100:00100000:3.0:1783969578.425264:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783969578.425272:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280623488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1783969578.425531:0:14797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783969578.425535:0:14797:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1783969578.425537:0:14797:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783969578.425539:0:14797:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783969578 -> 1783969578 00002000:00010000:3.0:1783969578.425541:0:14797:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1783969578.425582:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1870627280623488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 309us (457us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1783969578.425589:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1783969578.425626:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ac7bff34380/2, rc 0, transno 8589934595 00000100:00100000:3.0:1783969578.425631:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280623488:0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1783969578.425654:0:5816:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00080000:2.0:1783969578.425788:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783969578.425911:0:14163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac786092300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+14:14441:x1870627272254976:12345-192.168.203.39@tcp:44:lhsmtool_posix.0 Request processed in 71655us (72134us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969578.425920:0:14163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 51 00000100:00100000:1.0:1783969578.428481:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969578.432292:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272255104 00000100:00100000:3.0:1783969578.432307:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272255104 00000100:00100000:3.0:1783969578.432490:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00100000:3.0:1783969578.432503:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+7:2351:x1870627272255104:12345-192.168.203.39@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1783969578.432640:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+7:2351:x1870627272255104:12345-192.168.203.39@tcp:16:lhsmtool_posix.0 Request processed in 139us (4166us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969578.432649:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00100000:0.0:1783969578.437142:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969578.437441:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272255360 00000100:00100000:2.0:1783969578.437452:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272255360 00000100:00100000:2.0:1783969578.437556:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 52 00000100:00100000:2.0:1783969578.437568:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c1bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+14:14441:x1870627272255360:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783969578.437619:0:14821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783969578.437644:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098000/0xbacf56d076fac39f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63635 expref: 14 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.437662:0:14821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ac785336a00) 00010000:00010000:2.0:1783969578.437667:0:14821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783969578.437697:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac780031400/0xbacf56d076fac3ad lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.437838:0:14821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac780031400/0xbacf56d076fac3ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.438114:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac780031400/0xbacf56d076fac3ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783969578.438301:0:14821:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004514255d reply state 0000000006db79fe transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac780031400/0xbacf56d076fac3ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969578.438327:0:14821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783969578.438446:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c1bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+15:14441:x1870627272255360:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 878us (1310us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1783969578.438453:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 52 00000100:00100000:1.0:1783969578.441231:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969578.441422:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272255488 00000100:00100000:2.0:1783969578.441431:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272255488 00000100:00100000:2.0:1783969578.441481:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:2.0:1783969578.441490:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+7:14441:x1870627272255488:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783969578.441509:0:14799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783969578.441527:0:14799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb10c19c/0xbacf56d076fac3b4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac9bb7fb1fb63643 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.441558:0:14799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b39416df/0xbacf56d076fac3a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6363c expref: 8 pid: 14799 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.441568:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969578.441572:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969578.441577:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb10c19c/0xbacf56d076fac3b4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63643 expref: 8 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.441609:0:14799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b39416df/0xbacf56d076fac3a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6363c expref: 8 pid: 14799 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.441623:0:14799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b39416df/0xbacf56d076fac3a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6363c expref: 8 pid: 14799 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969578.441655:0:14799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14799:1870627280623616:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783969578.441727:0:14799:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7877cd840 going to sleep for 11 seconds 00010000:00010000:3.0:1783969578.442227:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac780031400/0xbacf56d076fac3ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.442237:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac780031400/0xbacf56d076fac3ad lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.442255:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac780031400/0xbacf56d076fac3ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.442260:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac780031400 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:3.0:1783969578.442265:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac780031400/0xbacf56d076fac3ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.442272:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac780031400/0xbacf56d076fac3ad lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.442287:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ac785336a00) 00010000:00010000:3.0:1783969578.442290:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783969578.442293:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac780031400/0xbacf56d076fac3ad lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.442299:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac780031400/0xbacf56d076fac3ad lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969578.446212:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969578.446283:0:14150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272255616 00000100:00100000:3.0:1783969578.446291:0:14150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272255616 00010000:00010000:3.0:1783969578.446333:0:14150:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b39416df/0xbacf56d076fac3a6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6363c expref: 9 pid: 14799 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969578.446383:0:14150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:3.0:1783969578.446392:0:14150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+9:2350:x1870627272255616:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969578.446408:0:14150:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969578.446429:0:14150:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b39416df/0xbacf56d076fac3a6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6363c expref: 9 pid: 14799 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.446462:0:14150:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b39416df/0xbacf56d076fac3a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6363c expref: 9 pid: 14799 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.446488:0:14150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969578.446493:0:14150:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969578.446499:0:14150:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb10c19c/0xbacf56d076fac3b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63643 expref: 9 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.446510:0:14150:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb10c19c/0xbacf56d076fac3b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63643 expref: 9 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.446545:0:14150:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bb10c19c/0xbacf56d076fac3b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63643 expref: 9 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969578.446559:0:14150:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7b57d3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14150:1870627280623744:192.168.203.39@tcp:105: 00000100:00100000:3.0:1783969578.446638:0:14150:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac788723180 going to sleep for 11 seconds 00000100:00100000:3.0:1783969578.449316:0:14150:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7b57d3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14150:1870627280623744:192.168.203.39@tcp:105: 00010000:00010000:3.0:1783969578.449339:0:14150:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969578.449522:0:14150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+9:2350:x1870627272255616:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 3128us (3316us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969578.449533:0:14150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 13 00010000:00010000:2.0:1783969578.449694:0:14799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b39416df/0xbacf56d076fac3a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6363c expref: 8 pid: 14799 timeout: 535 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969578.449723:0:14799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14799:1870627280623616:192.168.203.39@tcp:104: 00010000:00010000:2.0:1783969578.449742:0:14799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bb10c19c/0xbacf56d076fac3b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63643 expref: 7 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.449757:0:14799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ac780031600, rc 0) 00000100:00100000:2.0:1783969578.449783:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+7:14441:x1870627272255488:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 8294us (8560us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969578.449790:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:1.0:1783969578.452442:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969578.452521:0:14798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272255744 00000100:00100000:3.0:1783969578.452531:0:14798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272255744 00000100:00100000:3.0:1783969578.452584:0:14798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:3.0:1783969578.452609:0:14798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+7:2351:x1870627272255744:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783969578.452796:0:14798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1783969578.452799:0:14798:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1783969578 00002000:00010000:3.0:1783969578.452802:0:14798:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1783969577 00002000:00010000:3.0:1783969578.452804:0:14798:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783969578 -> 1783969578 00002000:00010000:3.0:1783969578.452806:0:14798:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1783969578.452892:0:14798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+8:2351:x1870627272255744:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 Request processed in 285us (458us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1783969578.452900:0:14798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:1.0:1783969578.455904:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969578.456200:0:14799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272255872 00000100:00100000:2.0:1783969578.456209:0:14799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272255872 00000100:00100000:2.0:1783969578.456258:0:14799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:2.0:1783969578.456266:0:14799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+8:2350:x1870627272255872:12345-192.168.203.39@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783969578.456304:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f3f73aba/0xbacf56d076fac3bb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.456322:0:14799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb10c19c/0xbacf56d076fac3b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63643 expref: 8 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.456347:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969578.456351:0:14799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783969578.456356:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3f73aba/0xbacf56d076fac3bb lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.456396:0:14799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bb10c19c/0xbacf56d076fac3b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63643 expref: 8 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.456409:0:14799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bb10c19c/0xbacf56d076fac3b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63643 expref: 8 pid: 14799 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969578.456423:0:14799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14799:1870627280623872:192.168.203.39@tcp:104: 00000100:00100000:2.0:1783969578.456491:0:14799:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7877cd840 going to sleep for 11 seconds 00000100:00100000:2.0:1783969578.459351:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969578.459459:0:14799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff38a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14799:1870627280623872:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783969578.459483:0:14799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f3f73aba/0xbacf56d076fac3bb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969578.459560:0:14149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272256000 00000100:00100000:3.0:1783969578.459567:0:14149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272256000 00010000:00010000:3.0:1783969578.459607:0:14149:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bb10c19c/0xbacf56d076fac3b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63643 expref: 9 pid: 14799 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969578.459643:0:14149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 14 00000100:00100000:3.0:1783969578.459652:0:14149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+9:2351:x1870627272256000:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783969578.459667:0:14149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783969578.459688:0:14149:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bb10c19c/0xbacf56d076fac3b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63643 expref: 9 pid: 14799 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.459701:0:14149:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bb10c19c/0xbacf56d076fac3b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63643 expref: 9 pid: 14799 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.459734:0:14149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb10c19c/0xbacf56d076fac3b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63643 expref: 9 pid: 14799 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.459772:0:14149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783969578.459777:0:14149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783969578.459784:0:14149:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3f73aba/0xbacf56d076fac3bb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.459794:0:14149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3f73aba/0xbacf56d076fac3bb lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.459825:0:14149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783969578.459912:0:14149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+8:2351:x1870627272256000:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 260us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969578.459919:0:14149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 14 00010000:00010000:0.0:1783969578.459980:0:14799:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f3f73aba/0xbacf56d076fac3bb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.459988:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3f73aba/0xbacf56d076fac3bb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.460011:0:14799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f3f73aba/0xbacf56d076fac3bb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.460018:0:14799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3f73aba/0xbacf56d076fac3bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.460025:0:14799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3f73aba/0xbacf56d076fac3bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.460032:0:14799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac780031000 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969578.460042:0:14799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3f73aba/0xbacf56d076fac3bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.460051:0:14799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3f73aba/0xbacf56d076fac3bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.460074:0:14799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3f73aba/0xbacf56d076fac3bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.460081:0:14799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3f73aba/0xbacf56d076fac3bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969578.460127:0:14799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+7:2350:x1870627272255872:12345-192.168.203.39@tcp:1:lhsmtool_posix.0 Request processed in 3861us (4230us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969578.460134:0:14799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:1.0:1783969578.464788:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969578.464903:0:14162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272256256 00000100:00100000:0.0:1783969578.464912:0:14162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272256256 00000100:00100000:0.0:1783969578.464978:0:14162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 53 00000100:00100000:0.0:1783969578.464988:0:14162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+14:14441:x1870627272256256:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783969578.465085:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129a00/0xbacf56d076fac3c2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.465104:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129a00/0xbacf56d076fac3c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.465115:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129a00/0xbacf56d076fac3c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.465390:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128a00/0xbacf56d076fac3c9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.465402:0:14162:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac391 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6362e expref: 15 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.465411:0:14162:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128a00/0xbacf56d076fac3c9 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.465445:0:14162:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac391 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6362e expref: 15 pid: 14162 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.465458:0:14162:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac391 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6362e expref: 15 pid: 14162 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969578.465472:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14162:1870627280624000:192.168.203.39@tcp:104: 00000100:00100000:0.0:1783969578.465551:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac787d413c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783969578.469457:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14162:1870627280624000:192.168.203.39@tcp:104: 00010000:00010000:0.0:1783969578.469487:0:14162:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128a00/0xbacf56d076fac3c9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969578.469980:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969578.470344:0:16181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272256384 00000100:00100000:0.0:1783969578.470352:0:16181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272256384 00010000:00010000:0.0:1783969578.470404:0:16181:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac391 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6362e expref: 16 pid: 14162 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969578.470445:0:16181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00100000:0.0:1783969578.470470:0:16181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+16:2351:x1870627272256384:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783969578.470486:0:16181:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783969578.470493:0:16181:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac391 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6362e expref: 16 pid: 14162 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.470507:0:16181:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac391 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6362e expref: 16 pid: 14162 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.470530:0:16181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786099400/0xbacf56d076fac391 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb6362e expref: 16 pid: 14162 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.470547:0:16181:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ac785336a00) 00010000:00010000:0.0:1783969578.470663:0:16181:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128a00/0xbacf56d076fac3c9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.470673:0:16181:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128a00/0xbacf56d076fac3c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.470680:0:16181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128a00/0xbacf56d076fac3c9 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.470760:0:16181:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783969578.470818:0:16181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+15:2351:x1870627272256384:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 349us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1783969578.470826:0:16181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 15 00010000:00010000:2.0:1783969578.474628:0:14162:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128a00/0xbacf56d076fac3c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.474646:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128a00/0xbacf56d076fac3c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783969578.474987:0:14162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1783969578.475148:0:14162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1783969578.475191:0:14162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1783969578.475274:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff38380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14162:1870627280624128:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783969578.475336:0:14162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969578.475493:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac798f95000 going to sleep for 11 seconds 00000100:00100000:1.0:1783969578.479708:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280624128 00000100:00100000:1.0:1783969578.479724:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280624128 00000100:00100000:1.0:1783969578.480466:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783969578.480481:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14162:x1870627280624128:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783969578.480610:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14162:x1870627280624128:12345-0@lo:1000:mdt00_000.0 Request processed in 135us (5273us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969578.480618:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783969578.480730:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff38380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14162:1870627280624128:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1783969578.481425:0:14162:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1783969578.481508:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14162:1870627280624256:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783969578.481563:0:14162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783969578.483825:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7877cda80 going to sleep for 11 seconds 00000100:00100000:2.0:1783969578.488102:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280624256 00000100:00100000:2.0:1783969578.488115:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280624256 00000100:00100000:2.0:1783969578.488175:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783969578.488184:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14162:x1870627280624256:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783969578.488529:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14162:x1870627280624256:12345-0@lo:1000:mdt00_000.0 Request processed in 345us (6964us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1783969578.488537:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783969578.488704:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14162:1870627280624256:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1783969578.488745:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128a00/0xbacf56d076fac3c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.488757:0:14162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128a00/0xbacf56d076fac3c9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.488765:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128a00/0xbacf56d076fac3c9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.488772:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac681128a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969578.488776:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128a00/0xbacf56d076fac3c9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.488785:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128a00/0xbacf56d076fac3c9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.488801:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ac785336a00) 00010000:00010000:0.0:1783969578.488804:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783969578.488809:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128a00/0xbacf56d076fac3c9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.488816:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681128a00/0xbacf56d076fac3c9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.488942:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac321 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.489022:0:14162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac321 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.489039:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac321 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.489045:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac786098800 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969578.489048:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac321 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.489066:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac321 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.489272:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac785336800) 00010000:00010000:0.0:1783969578.489276:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783969578.489283:0:14162:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129e00/0xbacf56d076fac328 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63612 expref: 18 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.489295:0:14162:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129e00/0xbacf56d076fac328 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63612 expref: 18 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.489304:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129e00/0xbacf56d076fac328 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63612 expref: 18 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.489341:0:14162:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129e00/0xbacf56d076fac328 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0xac9bb7fb1fb63612 expref: 18 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969578.489356:0:14162:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf741500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14162:1870627280624384:192.168.203.39@tcp:105: 00000100:00100000:0.0:1783969578.489514:0:14162:0:(client.c:2702:ptlrpc_set_wait()) set ffff9ac7877cda80 going to sleep for 11 seconds 00000100:00100000:1.0:1783969578.502249:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969578.502331:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272256512 00000100:00100000:2.0:1783969578.502341:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272256512 00000100:00100000:2.0:1783969578.502406:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:2.0:1783969578.502416:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b6273850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+19:14440:x1870627272256512:12345-192.168.203.39@tcp:49:dd.0 00000100:00100000:2.0:1783969578.502542:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b6273850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+19:14440:x1870627272256512:12345-192.168.203.39@tcp:49:dd.0 Request processed in 127us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969578.502550:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:0.0:1783969578.503285:0:14162:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf741500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14162:1870627280624384:192.168.203.39@tcp:105: 00010000:00010000:0.0:1783969578.503323:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac321 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.503333:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac786098800/0xbacf56d076fac321 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.503376:0:14162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129200/0xbacf56d076fac3d0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.503389:0:14162:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129200/0xbacf56d076fac3d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.503399:0:14162:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129200/0xbacf56d076fac3d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.503407:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129200/0xbacf56d076fac3d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.503413:0:14162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129200/0xbacf56d076fac3d0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.503419:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129200/0xbacf56d076fac3d0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.503425:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac681129200 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969578.503428:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129200/0xbacf56d076fac3d0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.503434:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129200/0xbacf56d076fac3d0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.503444:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac785336800) 00010000:00010000:0.0:1783969578.503451:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783969578.503455:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129200/0xbacf56d076fac3d0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.503461:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129200/0xbacf56d076fac3d0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.503470:0:14162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129a00/0xbacf56d076fac3c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.503476:0:14162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129a00/0xbacf56d076fac3c2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.503482:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129a00/0xbacf56d076fac3c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.503487:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac681129a00 already unused, calling callback (ffffffffc1e8e4f0) 00010000:00010000:0.0:1783969578.503490:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129a00/0xbacf56d076fac3c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.503495:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129a00/0xbacf56d076fac3c2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.503502:0:14162:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ac785336800) 00010000:00010000:0.0:1783969578.503504:0:14162:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783969578.503507:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129a00/0xbacf56d076fac3c2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.503512:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac681129a00/0xbacf56d076fac3c2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14162 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969578.503689:0:14162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+18:14441:x1870627272256256:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 38702us (38911us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1783969578.503706:0:14162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 53 00000020:00080000:0.0:1783969578.503710:0:14162:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783969578.504547:0:14197:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783969578.504554:0:14197:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783969578.504585:0:14197:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1783969578.504590:0:14197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1783969578.511234:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969578.512218:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272256768 00000100:00100000:2.0:1783969578.512230:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272256768 00000100:00100000:2.0:1783969578.512278:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:2.0:1783969578.512286:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+18:14441:x1870627272256768:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1783969578.515310:0:14166:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783969578.516352:0:14166:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1783969578.516433:0:14166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac780030600/0xbacf56d076fac3d7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.516450:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ac780030600/0xbacf56d076fac3d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.516471:0:14166:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ac780030600/0xbacf56d076fac3d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.516479:0:14166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac780030600/0xbacf56d076fac3d7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.516485:0:14166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ac780030600/0xbacf56d076fac3d7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.516491:0:14166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ac780030600/0xbacf56d076fac3d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.516566:0:14166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783969578.516676:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+20:14441:x1870627272256768:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 4385us (5447us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1783969578.516687:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11 00000020:00080000:2.0:1783969578.516692:0:14166:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783969578.524108:0:14151:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783969578.524122:0:14151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ac780030600/0xbacf56d076fac3d7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.524134:0:14151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac780030600 already unused, calling callback (ffffffffc1485230) 00010000:00010000:3.0:1783969578.524139:0:14151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac780030600/0xbacf56d076fac3d7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.524149:0:14151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ac780030600/0xbacf56d076fac3d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.524169:0:14151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ac785336a00) 00010000:00010000:3.0:1783969578.524172:0:14151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783969578.524177:0:14151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ac780030600/0xbacf56d076fac3d7 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.524203:0:14151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ac780030600/0xbacf56d076fac3d7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14166 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.525525:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969578.525531:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783969578.525533:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783969578.597520:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783969578.597543:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7b57d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280624512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783969578.597614:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969578.597942:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280624512 00000100:00100000:2.0:1783969578.597958:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280624512 00000100:00100000:2.0:1783969578.598027:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783969578.598037:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280624512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783969578.598079:0:14801:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783969578.598138:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1870627280624512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969578.598146:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1783969578.598541:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783969578.598678:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7b57d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3288:1870627280624512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783969578.685705:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969578.685751:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969578.685855:0:14802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272257024 00000100:00100000:0.0:1783969578.685886:0:14802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272257024 00000100:00100000:0.0:1783969578.685944:0:14802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272256896 00000100:00100000:0.0:1783969578.685958:0:14802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272256896 00000100:00100000:0.0:1783969578.685981:0:14802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:0.0:1783969578.685992:0:14802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+8:2349:x1870627272257024:12345-192.168.203.39@tcp:4:dd.0 00002000:00010000:0.0:1783969578.686041:0:14802:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a55372a, atime: 0x6a553729, ctime: 0x6a55372a, blocks: 0x1 00010000:00010000:0.0:1783969578.686061:0:14802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003263dc6b/0xbacf56d076fac3de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.686077:0:14802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1783969578.686083:0:14802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969578.686091:0:14802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003263dc6b/0xbacf56d076fac3de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.686105:0:14802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003263dc6b/0xbacf56d076fac3de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969578.694647:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1783969578.695258:0:3278:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969578.698674:0:14803:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1783969578.698922:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1783969578.700048:0:14804:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1783969578.700244:0:14803:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1783969578.700734:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969578.700750:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1783969578.700792:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1783969578.701653:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272257152 00000100:00100000:2.0:1783969578.701720:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272257152 00000100:00100000:2.0:1783969578.701775:0:14803:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1783969578.701781:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272257280 00000100:00100000:2.0:1783969578.701784:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272257280 00000100:00100000:2.0:1783969578.701795:0:14803:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1783969578.701800:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272257536 00000100:00100000:2.0:1783969578.701802:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272257536 00000100:00100000:2.0:1783969578.701813:0:14803:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1783969578.701817:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272257408 00000100:00100000:2.0:1783969578.701819:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272257408 00000100:00100000:2.0:1783969578.701829:0:14803:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1783969578.701832:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272257664 00000100:00100000:2.0:1783969578.701834:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272257664 00000100:00100000:2.0:1783969578.701854:0:14803:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1783969578.701882:0:14803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627272257792 00000100:00100000:2.0:1783969578.701886:0:14803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627272257792 00000100:00100000:3.0:1783969578.705323:0:16295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1 00000100:00100000:3.0:1783969578.705339:0:16295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+15:2349:x1870627272256896:12345-192.168.203.39@tcp:4:dd.0 00010000:00010000:3.0:1783969578.705384:0:16295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d38543be/0xbacf56d076fac3e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.705402:0:16295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969578.705407:0:16295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969578.705414:0:16295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d38543be/0xbacf56d076fac3e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.705429:0:16295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d38543be/0xbacf56d076fac3e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783969578.769444:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:2.0:1783969578.769502:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:3.0:1783969578.772308:0:14802:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1783969578.772317:0:14802:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:3.0:1783969578.772332:0:14802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003263dc6b/0xbacf56d076fac3de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.772365:0:14802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003263dc6b/0xbacf56d076fac3de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.772374:0:14802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003263dc6b/0xbacf56d076fac3de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.772382:0:14802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac681129200 already unused, calling callback (ffffffffc1485230) 00010000:00010000:3.0:1783969578.772386:0:14802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003263dc6b/0xbacf56d076fac3de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.772396:0:14802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003263dc6b/0xbacf56d076fac3de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.772416:0:14802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003263dc6b/0xbacf56d076fac3de lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.772425:0:14802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003263dc6b/0xbacf56d076fac3de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969578.772527:0:14802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+15:2349:x1870627272257024:12345-192.168.203.39@tcp:4:dd.0 Request processed in 86532us (86826us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1783969578.772537:0:14802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:3.0:1783969578.772569:0:14802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00100000:3.0:1783969578.772581:0:14802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+14:2348:x1870627272257152:12345-192.168.203.39@tcp:4:dd.0 00010000:00010000:3.0:1783969578.772609:0:14802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eff64d6a/0xbacf56d076fac3ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.772627:0:14802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969578.772632:0:14802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783969578.772638:0:14802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eff64d6a/0xbacf56d076fac3ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969578.772650:0:14802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eff64d6a/0xbacf56d076fac3ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969578.791195:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783969578.812665:0:16295:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00010000:00010000:2.0:1783969578.812686:0:16295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d38543be/0xbacf56d076fac3e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.812699:0:16295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d38543be/0xbacf56d076fac3e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.812709:0:16295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d38543be/0xbacf56d076fac3e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.812717:0:16295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6e00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:2.0:1783969578.812722:0:16295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d38543be/0xbacf56d076fac3e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.812748:0:16295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d38543be/0xbacf56d076fac3e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.812768:0:16295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d38543be/0xbacf56d076fac3e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.812776:0:16295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d38543be/0xbacf56d076fac3e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783969578.813120:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000100:00100000:2.0:1783969578.813187:0:16295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+14:2349:x1870627272256896:12345-192.168.203.39@tcp:4:dd.0 Request processed in 107847us (127429us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1783969578.813198:0:16295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1 00000100:00100000:2.0:1783969578.813228:0:16295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3 00000100:00100000:2.0:1783969578.813241:0:16295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7a7a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+13:2348:x1870627272257280:12345-192.168.203.39@tcp:4:dd.0 00010000:00010000:2.0:1783969578.813273:0:16295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070791dd9/0xbacf56d076fac3f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.813285:0:16295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969578.813289:0:16295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969578.813295:0:16295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070791dd9/0xbacf56d076fac3f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.813306:0:16295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070791dd9/0xbacf56d076fac3f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783969578.855342:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:0.0:1783969578.855523:0:14802:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:0.0:1783969578.855528:0:14802:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1783969578.855542:0:14802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eff64d6a/0xbacf56d076fac3ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.855576:0:14802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eff64d6a/0xbacf56d076fac3ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.855585:0:14802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eff64d6a/0xbacf56d076fac3ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.855592:0:14802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac783de6200 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969578.855597:0:14802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eff64d6a/0xbacf56d076fac3ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.855606:0:14802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eff64d6a/0xbacf56d076fac3ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.855625:0:14802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eff64d6a/0xbacf56d076fac3ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.855634:0:14802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eff64d6a/0xbacf56d076fac3ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969578.855735:0:14802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+14:2348:x1870627272257152:12345-192.168.203.39@tcp:4:dd.0 Request processed in 83153us (161093us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1783969578.855746:0:14802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00100000:0.0:1783969578.855787:0:14802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:0.0:1783969578.855799:0:14802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+13:2349:x1870627272257536:12345-192.168.203.39@tcp:4:dd.0 00010000:00010000:0.0:1783969578.855832:0:14802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075999be1/0xbacf56d076fac3fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.856446:0:14802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969578.856450:0:14802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969578.856458:0:14802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075999be1/0xbacf56d076fac3fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.856472:0:14802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075999be1/0xbacf56d076fac3fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783969578.899996:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:2.0:1783969578.903257:0:16295:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:2.0:1783969578.903267:0:16295:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:2.0:1783969578.903284:0:16295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070791dd9/0xbacf56d076fac3f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.903297:0:16295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070791dd9/0xbacf56d076fac3f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.903305:0:16295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070791dd9/0xbacf56d076fac3f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.903312:0:16295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac780030400 already unused, calling callback (ffffffffc1485230) 00010000:00010000:2.0:1783969578.903316:0:16295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070791dd9/0xbacf56d076fac3f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.903323:0:16295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070791dd9/0xbacf56d076fac3f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.903342:0:16295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070791dd9/0xbacf56d076fac3f3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.903349:0:16295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070791dd9/0xbacf56d076fac3f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783969578.903558:0:16295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7a7a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+12:2348:x1870627272257280:12345-192.168.203.39@tcp:4:dd.0 Request processed in 90316us (208297us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1783969578.903579:0:16295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3 00000100:00100000:2.0:1783969578.903615:0:16295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:2.0:1783969578.903626:0:16295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+11:2349:x1870627272257408:12345-192.168.203.39@tcp:4:dd.0 00010000:00010000:2.0:1783969578.903674:0:16295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6a55749/0xbacf56d076fac401 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.903687:0:16295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969578.903691:0:16295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783969578.903697:0:16295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6a55749/0xbacf56d076fac401 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783969578.903709:0:16295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6a55749/0xbacf56d076fac401 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783969578.947393:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:0.0:1783969578.949918:0:14802:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:0.0:1783969578.949938:0:14802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075999be1/0xbacf56d076fac3fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.949958:0:14802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075999be1/0xbacf56d076fac3fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.949966:0:14802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075999be1/0xbacf56d076fac3fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.949973:0:14802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac681128a00 already unused, calling callback (ffffffffc1485230) 00010000:00010000:0.0:1783969578.949977:0:14802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075999be1/0xbacf56d076fac3fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.949985:0:14802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075999be1/0xbacf56d076fac3fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.950005:0:14802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075999be1/0xbacf56d076fac3fa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.950025:0:14802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075999be1/0xbacf56d076fac3fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783969578.950128:0:14802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+11:2349:x1870627272257536:12345-192.168.203.39@tcp:4:dd.0 Request processed in 94327us (251204us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1783969578.950139:0:14802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:0.0:1783969578.950174:0:14802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:0.0:1783969578.950187:0:14802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+10:2348:x1870627272257664:12345-192.168.203.39@tcp:4:dd.0 00010000:00010000:0.0:1783969578.950215:0:14802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e95a3971/0xbacf56d076fac408 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.950227:0:14802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1783969578.950231:0:14802:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783969578.950237:0:14802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e95a3971/0xbacf56d076fac408 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783969578.950249:0:14802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e95a3971/0xbacf56d076fac408 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783969578.992687:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:1.0:1783969578.994145:0:16295:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:1.0:1783969578.994152:0:16295:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1783969578.994165:0:16295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6a55749/0xbacf56d076fac401 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969578.994179:0:16295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6a55749/0xbacf56d076fac401 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969578.994187:0:16295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6a55749/0xbacf56d076fac401 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969578.994194:0:16295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac780030600 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969578.994199:0:16295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6a55749/0xbacf56d076fac401 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969578.994208:0:16295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6a55749/0xbacf56d076fac401 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969578.994226:0:16295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6a55749/0xbacf56d076fac401 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969578.994233:0:16295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6a55749/0xbacf56d076fac401 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969578.994377:0:16295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+10:2349:x1870627272257408:12345-192.168.203.39@tcp:4:dd.0 Request processed in 90750us (293641us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1783969578.994394:0:16295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:1.0:1783969578.994425:0:16295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:1.0:1783969578.994436:0:16295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7b57d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+9:2348:x1870627272257792:12345-192.168.203.39@tcp:4:dd.0 00010000:00010000:1.0:1783969578.994464:0:16295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aef05a00/0xbacf56d076fac40f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969578.994475:0:16295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969578.994479:0:16295:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783969578.994485:0:16295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aef05a00/0xbacf56d076fac40f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969578.994497:0:16295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aef05a00/0xbacf56d076fac40f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783969579.036879:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:1.0:1783969579.039217:0:14802:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1783969579.039227:0:14802:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:1.0:1783969579.039241:0:14802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e95a3971/0xbacf56d076fac408 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969579.039255:0:14802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e95a3971/0xbacf56d076fac408 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969579.039265:0:14802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e95a3971/0xbacf56d076fac408 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969579.039286:0:14802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac681129800 already unused, calling callback (ffffffffc1485230) 00010000:00010000:1.0:1783969579.039292:0:14802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e95a3971/0xbacf56d076fac408 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969579.039301:0:14802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e95a3971/0xbacf56d076fac408 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969579.039321:0:14802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e95a3971/0xbacf56d076fac408 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783969579.039330:0:14802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e95a3971/0xbacf56d076fac408 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783969579.039434:0:14802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+9:2348:x1870627272257664:12345-192.168.203.39@tcp:4:dd.0 Request processed in 89246us (338677us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1783969579.039444:0:14802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6 00000001:00080000:1.0:1783969579.103126:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:3.0:1783969579.103448:0:16295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aef05a00/0xbacf56d076fac40f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969579.103464:0:16295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aef05a00/0xbacf56d076fac40f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969579.103474:0:16295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aef05a00/0xbacf56d076fac40f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969579.103482:0:16295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ac683624200 already unused, calling callback (ffffffffc1485230) 00010000:00010000:3.0:1783969579.103487:0:16295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aef05a00/0xbacf56d076fac40f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969579.103495:0:16295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aef05a00/0xbacf56d076fac40f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969579.103515:0:16295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aef05a00/0xbacf56d076fac40f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783969579.103537:0:16295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aef05a00/0xbacf56d076fac40f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783969579.103636:0:16295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7b57d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6fcda0ab-5b57-4e8f-beca-401d3c9668a1+5:2348:x1870627272257792:12345-192.168.203.39@tcp:4:dd.0 Request processed in 109199us (402839us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1783969579.103646:0:16295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:0.0:1783969579.621176:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783969579.621197:0:3287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bf741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280624640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783969579.621260:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969579.621376:0:14801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280624640 00000100:00100000:2.0:1783969579.621384:0:14801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280624640 00000100:00100000:2.0:1783969579.621438:0:14801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783969579.621448:0:14801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bf741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280624640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783969579.621470:0:14801:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3859808256 avail 3849322496 00000100:00100000:2.0:1783969579.621517:0:14801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bf741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1870627280624640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969579.621524:0:14801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783969579.621558:0:3287:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1783969579.621577:0:3287:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ac7bff34380, transno 8589934595 00000004:00080000:2.0:1783969579.621589:0:3287:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1783969579.621615:0:3287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bf741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3287:1870627280624640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783969579.622694:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7c1bbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1870627280625152:0@lo:400:kworker.0 00000100:00100000:2.0:1783969579.622741:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969579.622767:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783969579.622773:0:3288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870627280625024:0@lo:400:kworker.0 00000100:00100000:2.0:1783969579.622796:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783969579.622827:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280625152 00000100:00100000:2.0:1783969579.622832:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280625152 00000100:00100000:2.0:1783969579.622897:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280625024 00000100:00100000:2.0:1783969579.622901:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280625024 00000100:00100000:2.0:1783969579.622918:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783969579.622925:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870627280625152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969579.622968:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1870627280625152:12345-0@lo:400:kworker.0 Request processed in 42us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969579.622975:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783969579.622989:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783969579.622994:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7bff35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870627280625024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783969579.623019:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7bff35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1870627280625024:12345-0@lo:400:kworker.0 Request processed in 24us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1783969579.623025:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783969579.623066:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3288:1870627280625024:0@lo:400:kworker.0 00000100:00100000:2.0:1783969579.623076:0:3288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7c1bbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3288:1870627280625152:0@lo:400:kworker.0 00000100:00100000:3.0:1783969579.623177:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280624896:0@lo:400:kworker.0 00000100:00080000:0.0:1783969579.623203:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969579.623218:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969579.623254:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783969579.623260:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c75a22f-689e-4536-9c19-8125b0e8c51a:3286:1870627280624768:0@lo:400:kworker.0 00000100:00100000:3.0:1783969579.623287:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969579.623319:0:3286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9ac7bff34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1870627280625280:0@lo:400:kworker.0 00000100:00100000:3.0:1783969579.623340:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783969579.623377:0:14821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280625280 00000100:00100000:3.0:1783969579.623381:0:14821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280625280 00000100:00100000:3.0:1783969579.623411:0:14821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783969579.623418:0:14821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1870627280625280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783969579.623453:0:14821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1870627280625280:12345-0@lo:400:kworker.0 Request processed in 35us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1783969579.623459:0:14821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1783969579.623475:0:14159:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783969579.623491:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3286:1870627280625280:0@lo:400:kworker.0 00000100:00100000:1.0:1783969579.623686:0:14797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280624896 00000100:00100000:1.0:1783969579.623691:0:14797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280624896 00000100:00100000:0.0:1783969579.623698:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870627280624768 00000100:00100000:0.0:1783969579.623705:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870627280624768 00000100:00100000:1.0:1783969579.623732:0:14797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783969579.623742:0:14797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7c18e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280624896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783969579.623767:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1783969579.623777:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ac7981b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:3286:x1870627280624768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783969579.623789:0:14797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7c18e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1870627280624896:12345-0@lo:400:kworker.0 Request processed in 48us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969579.623797:0:14797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783969579.623822:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ac7981b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5c75a22f-689e-4536-9c19-8125b0e8c51a+19:3286:x1870627280624768:12345-0@lo:400:kworker.0 Request processed in 46us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1783969579.623830:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5c75a22f-689e-4536-9c19-8125b0e8c51a:3286:1870627280624768:0@lo:400:kworker.0 00000100:00100000:0.0:1783969579.623831:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1783969579.623882:0:3286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9ac7bff3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3286:1870627280624896:0@lo:400:kworker.0 00010000:00010000:2.0:1783969579.813011:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783969580.724275:0:16334:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1783969580.838237:0:14152:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783969581.605221:0:14197:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783969581.605230:0:14197:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783969581.605263:0:14197:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1783969581.605269:0:14197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1783969581.861500:0:14151:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29081 lines, 29081 kept, 0 dropped, 0 bad.